Data's Blog

//----

Job

1) Once in the glue console click on AWS Glue Studio.

2) When inside AWS GLUE Studio you should click on ‘View jobs’.

3) Select your source data and the target and then click on create a button on the right.

Create Job

  • Name – UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.

    The name you assign to this job definition.

  • JobMode – 

    A mode that describes how a job was created. Valid values are:

    • SCRIPT - The job was created using the AWS Glue Studio script editor.

    • VISUAL - The job was created using the AWS Glue Studio visual editor.

    • NOTEBOOK - The job was created using an interactive sessions notebook.

    When the JobMode field is missing or null, SCRIPT is assigned as the default value.

  • JobRunQueuingEnabled – Boolean.

    Specifies whether job run queuing is enabled for the job runs for this job.

     

  • Description –

  • LogUri –

  • Role – AM role associated with this job.

  • CreatedOn – Timestamp.

    The time and date that this job definition was created.

  • LastModifiedOn – Timestamp.

    The last point in time when this job definition was modified.

  • ExecutionProperty – maximum number of concurrent runs allowed for this job.

  • Command – A JobCommand object.

    The JobCommand that runs this job.

  • Connections – A ConnectionsList object.

    The connections used for this job.

  • MaxRetries – Number (integer).

    The maximum number of times to retry this job after a JobRun fails.

  • AllocatedCapacity – Number (integer).

     

     

  • Timeout – Number (integer), at least 1.

  • MaxCapacity – Number (double).

  • WorkerType – UTF-8 string (valid values: Standard="" | G.1X="" | G.2X="" | G.025X="" | G.4X="" | G.8X="" | Z.2X="").

  • NumberOfWorkers – Number (integer).

    The number of workers of a defined workerType that are allocated when a job runs.

  •  

    SecurityConfiguration –

    The name of the SecurityConfiguration structure to be used with this job.

  •  

  • NotificationProperty – 

    Specifies configuration properties of a job notification.

  • Running – Boolean.

    This field is reserved for future use.

  • GlueVersion – UTF-8 string, not less than 1 or more than 255 bytes long, matching 

     

  • CodeGenConfigurationNodes – A map array of key-value pairs.

     

  • ExecutionClass – UTF-8 string, not more than 16 bytes long (valid values: FLEX="" | STANDARD="").

     

  • SourceControlDetails – 

    The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

  • MaintenanceWindow – 

     

  • ProfileName – 

    The name of an AWS Glue usage profile associated with the job.

Trigger :

Trigger is two type :

1) scheduled

2) Condition/event based

 

Workflow :

Workflow used to run more then one job on some condition .

//----
Choose Colour