Skip to content

Commit f9e8723

Browse files
authored
[incr pipelines][DINO-284] enable sync by default for new schematized pipelines (#2255)
* [incr pipelines][DINO-284] enable sync for new schematized pipelines * format * use enum * test * version * format * make schema_type as required
1 parent b787691 commit f9e8723

File tree

1 file changed

+41
-35
lines changed

1 file changed

+41
-35
lines changed

openapi/src/data-pipelines.openapi.yaml

Lines changed: 41 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -340,7 +340,8 @@ components:
340340
project_id:
341341
$ref: '#/components/schemas/ProjectId'
342342
type:
343-
$ref: '#/components/schemas/PipelineType'
343+
type: string
344+
default: gcs-raw
344345
trial:
345346
type: boolean
346347
default: false
@@ -479,7 +480,8 @@ components:
479480
project_id:
480481
$ref: '#/components/schemas/ProjectId'
481482
type:
482-
$ref: '#/components/schemas/PipelineType'
483+
type: string
484+
default: s3-raw
483485
trial:
484486
type: boolean
485487
default: false
@@ -637,7 +639,8 @@ components:
637639
project_id:
638640
$ref: '#/components/schemas/ProjectId'
639641
type:
640-
$ref: '#/components/schemas/PipelineType'
642+
type: string
643+
default: azure-raw
641644
trial:
642645
type: boolean
643646
default: false
@@ -767,7 +770,8 @@ components:
767770
project_id:
768771
$ref: '#/components/schemas/ProjectId'
769772
type:
770-
$ref: '#/components/schemas/PipelineType'
773+
type: string
774+
default: bigquery
771775
trial:
772776
type: boolean
773777
default: false
@@ -822,11 +826,10 @@ components:
822826
Mixpanel event data. `people` exports Mixpanel user data.
823827
sync:
824828
type: boolean
825-
default: false
829+
enum:
830+
- true
831+
default: true
826832
description: >
827-
**Default**: `false`
828-
829-
830833
A value of `true` updates exported data with any changes that occur
831834
in your Mixpanel dataset. These changes include deletions, late
832835
data, and imports that fall into your export window.
@@ -919,6 +922,8 @@ components:
919922
- type
920923
- from_date
921924
- bq_region
925+
- sync
926+
- schema_type
922927

923928
SchematizedSnowflakePipeline:
924929
title: Schematized Snowflake Pipeline
@@ -927,7 +932,8 @@ components:
927932
project_id:
928933
$ref: '#/components/schemas/ProjectId'
929934
type:
930-
$ref: '#/components/schemas/PipelineType'
935+
type: string
936+
default: snowflake
931937
trial:
932938
type: boolean
933939
default: false
@@ -982,11 +988,10 @@ components:
982988
Mixpanel event data. `people` exports Mixpanel user data.
983989
sync:
984990
type: boolean
985-
default: false
991+
enum:
992+
- true
993+
default: true
986994
description: >
987-
**Default**: `false`
988-
989-
990995
A value of `true` updates exported data with any changes that occur
991996
in your Mixpanel dataset. These changes include deletions, late
992997
data, and imports that fall into your export window.
@@ -1057,6 +1062,8 @@ components:
10571062
- from_date
10581063
- snowflake_share_with
10591064
- region
1065+
- sync
1066+
- schema_type
10601067

10611068
SchematizedAWSPipeline:
10621069
title: Schematized AWS Pipeline
@@ -1065,7 +1072,8 @@ components:
10651072
project_id:
10661073
$ref: '#/components/schemas/ProjectId'
10671074
type:
1068-
$ref: '#/components/schemas/PipelineType'
1075+
type: string
1076+
default: aws
10691077
trial:
10701078
type: boolean
10711079
default: false
@@ -1120,11 +1128,10 @@ components:
11201128
Mixpanel event data. `people` exports Mixpanel user data.
11211129
sync:
11221130
type: boolean
1123-
default: false
1131+
enum:
1132+
- true
1133+
default: true
11241134
description: >
1125-
**Default**: `false`
1126-
1127-
11281135
A value of `true` updates exported data with any changes that occur
11291136
in your Mixpanel dataset. These changes include deletions, late
11301137
data, and imports that fall into your export window.
@@ -1266,6 +1273,8 @@ components:
12661273
- s3_bucket
12671274
- s3_region
12681275
- s3_role
1276+
- sync
1277+
- schema_type
12691278

12701279
SchematizedAzurePipeline:
12711280
title: Schematized Azure Pipeline
@@ -1274,7 +1283,8 @@ components:
12741283
project_id:
12751284
$ref: '#/components/schemas/ProjectId'
12761285
type:
1277-
$ref: '#/components/schemas/PipelineType'
1286+
type: string
1287+
default: azure-blob
12781288
trial:
12791289
type: boolean
12801290
default: false
@@ -1329,11 +1339,10 @@ components:
13291339
Mixpanel event data. `people` exports Mixpanel user data.
13301340
sync:
13311341
type: boolean
1332-
default: false
1342+
enum:
1343+
- true
1344+
default: true
13331345
description: >
1334-
**Default**: `false`
1335-
1336-
13371346
A value of `true` updates exported data with any changes that occur
13381347
in your Mixpanel dataset. These changes include deletions, late
13391348
data, and imports that fall into your export window.
@@ -1426,6 +1435,8 @@ components:
14261435
- client_id
14271436
- client_secret
14281437
- tenant_id
1438+
- sync
1439+
- schema_type
14291440

14301441
SchematizedGCSPipeline:
14311442
title: Schematized GCS Pipeline
@@ -1434,7 +1445,8 @@ components:
14341445
project_id:
14351446
$ref: '#/components/schemas/ProjectId'
14361447
type:
1437-
$ref: '#/components/schemas/PipelineType'
1448+
type: string
1449+
default: gcs-schema
14381450
trial:
14391451
type: boolean
14401452
default: false
@@ -1474,9 +1486,10 @@ components:
14741486
Mixpanel event data. `people` exports Mixpanel user data.
14751487
sync:
14761488
type: boolean
1477-
default: false
1489+
enum:
1490+
- true
1491+
default: true
14781492
description: >
1479-
**Default**: `false`
14801493
A value of `true` updates exported data with any changes that occur
14811494
in your Mixpanel dataset. These changes include deletions, late
14821495
data, and imports that fall into your export window.
@@ -1575,6 +1588,8 @@ components:
15751588
- from_date
15761589
- gcs_bucket
15771590
- gcs_region
1591+
- sync
1592+
- schema_type
15781593
ErrorResponse:
15791594
type: object
15801595
properties:
@@ -1613,15 +1628,6 @@ components:
16131628
SchematizedEditParams:
16141629
allOf:
16151630
- $ref: '#/components/schemas/RawEditParams'
1616-
- type: object
1617-
properties:
1618-
enable_sync:
1619-
type: boolean
1620-
default: false
1621-
description: >
1622-
A value of `true` enables sync for your pipelines which updates exported data with
1623-
any changes that occur in your Mixpanel dataset. These changes include deletions, late
1624-
data, and imports that fall into your export window.
16251631
AzureCommonEditParams:
16261632
type: object
16271633
properties:

0 commit comments

Comments
 (0)