Your Apps in Action

Use this form to visualize JSON Schema for a Comet Data Pipeline..


{{repoTitle.MainEntity}}

types types

# name primitiveType pattern zone sample comment indexMapping Actions
{{$index+1}}. {{row.name}} {{row.primitiveType}} {{row.pattern}} {{row.zone}} {{row.sample}} {{row.comment}} {{row.indexMapping}}    
.env
_

.transform
_

transform.tasks tasks

# sql engine domain dataset write area sink.type sink.name sink.id sink.timestamp Actions
{{$index+1}}. {{row.sql}} {{row.engine}} {{row.domain}} {{row.dataset}} {{row.write}} {{row.area}} {{row.sink.type}} {{row.sink.name}} {{row.sink.id}} {{row.sink.timestamp}}    
.transform.views
_

.load
_

.load.metadata
_

.load.metadata.partition
_

load.metadata.partition.attributes attributes

# Values Actions
{{$index+1}}.
.load.metadata.sink
_

load.metadata.clustering List of attributes to use for clustering

# Values Actions
{{$index+1}}.
.load.metadata.xml
_

load.schemaRefs List of files containing the schemas. Should start with an '_' and be located in the same folder.

# Values Actions
{{$index+1}}.
load.schemas List of schemas for each dataset in this domain. A domain usually contains multiple schemas. Each schema defining how the contents of the input file should be parsed. See Schema for more details.

# name pattern metadata.partition.sampling metadata.mode metadata.format metadata.encoding metadata.multiline metadata.array metadata.withHeader metadata.separator Actions
{{$index+1}}. {{row.name}} {{row.pattern}} {{row.metadata.partition.sampling}} {{row.metadata.mode}} {{row.metadata.format}} {{row.metadata.encoding}} {{row.metadata.multilineSelected.DisplayText}} {{row.metadata.arraySelected.DisplayText}} {{row.metadata.withHeaderSelected.DisplayText}} {{row.metadata.separator}}    
load.extensions recognized filename extensions. json, csv, dsv, psv are recognized by default. Only files with these extensions will be moved to the pending folder.

# Values Actions
{{$index+1}}.
.assertions
_

.views
_

schemas List of schemas for each dataset in this domain. A domain usually contains multiple schemas. Each schema defining how the contents of the input file should be parsed. See Schema for more details.

# name pattern metadata.partition.sampling metadata.mode metadata.format metadata.encoding metadata.multiline metadata.array metadata.withHeader metadata.separator Actions
{{$index+1}}. {{row.name}} {{row.pattern}} {{row.metadata.partition.sampling}} {{row.metadata.mode}} {{row.metadata.format}} {{row.metadata.encoding}} {{row.metadata.multilineSelected.DisplayText}} {{row.metadata.arraySelected.DisplayText}} {{row.metadata.withHeaderSelected.DisplayText}} {{row.metadata.separator}}    
{{repoTitle.MainEntity}}

partition List of columns used for partitioning the output.

# Values Actions
{{$index+1}}.
presql List of SQL requests to executed before the main SQL request is run

# Values Actions
{{$index+1}}.
postsql List of SQL requests to executed after the main SQL request is run

# Values Actions
{{$index+1}}.
.sink
_transform_tasks

rls rls

# name predicate Actions
{{$index+1}}. {{row.name}} {{row.predicate}}    
.assertions
_transform_tasks

{{repoTitle.MainEntity}}

grants user / groups / service accounts to which this security level is applied. ex : user:me@mycompany.com,group:group@mycompany.com,serviceAccount:mysa@google-accounts.com

# Values Actions
{{$index+1}}.
{{repoTitle.MainEntity}}

primaryKey List of columns that make up the primary key

# Values Actions
{{$index+1}}.
attributes Attributes parsing rules.

# name type foreignKey array required privacy comment rename metricType position.first Actions
{{$index+1}}. {{row.name}} {{row.type}} {{row.foreignKey}} {{row.arraySelected.DisplayText}} {{row.requiredSelected.DisplayText}} {{row.privacy}} {{row.comment}} {{row.rename}} {{row.metricType}} {{row.position.first}}    
.metadata
_load_schemas

.metadata.partition
_load_schemas

metadata.partition.attributes attributes

# Values Actions
{{$index+1}}.
.metadata.sink
_load_schemas

metadata.clustering List of attributes to use for clustering

# Values Actions
{{$index+1}}.
.metadata.xml
_load_schemas

.merge
_load_schemas

merge.key list of attributes to join existing with incoming dataset. Use renamed columns here.

# Values Actions
{{$index+1}}.
presql Reserved for future use.

# Values Actions
{{$index+1}}.
postsql Reserved for future use.

# Values Actions
{{$index+1}}.
tags Set of string to attach to this Schema

# Values Actions
{{$index+1}}.
rls Experimental. Row level security to this to this schema.

# name predicate Actions
{{$index+1}}. {{row.name}} {{row.predicate}}    
.assertions
_load_schemas

{{repoTitle.MainEntity}}

attributes List of sub-attributes (valid for JSON and XML files only)

# name type foreignKey array required privacy comment rename metricType position.first Actions
{{$index+1}}. {{row.name}} {{row.type}} {{row.foreignKey}} {{row.arraySelected.DisplayText}} {{row.requiredSelected.DisplayText}} {{row.privacy}} {{row.comment}} {{row.rename}} {{row.metricType}} {{row.position.first}}    
.position
_attributes

tags Tags associated with this attribute

# Values Actions
{{$index+1}}.
{{repoTitle.MainEntity}}

primaryKey List of columns that make up the primary key

# Values Actions
{{$index+1}}.
attributes Attributes parsing rules.

# name type foreignKey array required privacy comment rename metricType position.first Actions
{{$index+1}}. {{row.name}} {{row.type}} {{row.foreignKey}} {{row.arraySelected.DisplayText}} {{row.requiredSelected.DisplayText}} {{row.privacy}} {{row.comment}} {{row.rename}} {{row.metricType}} {{row.position.first}}    
.metadata
_schemas

.metadata.partition
_schemas

metadata.partition.attributes attributes

# Values Actions
{{$index+1}}.
.metadata.sink
_schemas

metadata.clustering List of attributes to use for clustering

# Values Actions
{{$index+1}}.
.metadata.xml
_schemas

.merge
_schemas

merge.key list of attributes to join existing with incoming dataset. Use renamed columns here.

# Values Actions
{{$index+1}}.
presql Reserved for future use.

# Values Actions
{{$index+1}}.
postsql Reserved for future use.

# Values Actions
{{$index+1}}.
tags Set of string to attach to this Schema

# Values Actions
{{$index+1}}.
rls Experimental. Row level security to this to this schema.

# name predicate Actions
{{$index+1}}. {{row.name}} {{row.predicate}}    
.assertions
_schemas


{{message}}