Run an Airbyte sync.
type: "io.kestra.plugin.airbyte.connections.Sync"id: airbyte_sync
namespace: company.team
tasks:
- id: sync
type: io.kestra.plugin.airbyte.connections.Sync
url: http://localhost:8080
connectionId: e3b1ce92-547c-436f-b1e8-23b6936c12cd
Trigger a single Airbyte sync on schedule
id: airbyte_sync
namespace: company.team
tasks:
- id: data_ingestion
type: io.kestra.plugin.airbyte.connections.Sync
connectionId: e3b1ce92-547c-436f-b1e8-23b6936c12ab
url: http://host.docker.internal:8000/
username: "{{ secret('AIRBYTE_USERNAME') }}"
password: "{{ secret('AIRBYTE_PASSWORD') }}"
triggers:
- id: every_minute
type: io.kestra.plugin.core.trigger.Schedule
cron: "*/1 * * * *"
The connection ID to sync.
The URL of your Airbyte instance.
Application credentials.
Applications allow you to generate tokens to access the Airbyte API.
trueSpecify whether task should fail if a sync is already running.
PT10SdurationHTTP connection timeout.
PT1HdurationThe maximum total wait duration.
The HTTP client configuration.
Basic authentication password.
PT1SdurationSpecify frequency for sync attempt state check API call.
API key.
Basic authentication username.
trueWait for the job to end.
Allowing capture of job status & logs.
Whether a sync was already running.
The job ID created.
durationThe time allowed to establish a connection to the server before failing.
PT5MdurationThe time allowed for a read connection to remain idle before closing it.
The password for HTTP basic authentication.
The username for HTTP basic authentication.
falseIf true, allow a failed response code (response code >= 400)
List of response code allowed for this request
The authentification to use.
The password for HTTP basic authentication.
The username for HTTP basic authentication.
durationThe time allowed to establish a connection to the server before failing.
durationThe time an idle connection can remain in the client's connection pool before being closed.
UTF-8The default charset for the request.
trueWhether redirects should be followed automatically.
ALLTRACEDEBUGINFOWARNERROROFFNOT_SPECIFIEDThe log level for the HTTP client.
REQUEST_HEADERSREQUEST_BODYRESPONSE_HEADERSRESPONSE_BODYThe enabled log.
The maximum content length of the response.
The proxy configuration.
The address of the proxy server.
The password for proxy authentication.
The port of the proxy server.
DIRECTHTTPSOCKSThe type of proxy to use.
The username for proxy authentication.
durationThe time allowed for a read connection to remain idle before closing it.
durationThe maximum time allowed for reading data from the server before failing.
The SSL request options
The timeout configuration.
The address of the proxy server.
The password for proxy authentication.
The port of the proxy server.
DIRECTDIRECTHTTPSOCKSThe type of proxy to use.
The username for proxy authentication.
Whether to disable checking of the remote SSL certificate.
Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.
Client ID.
Client Secret.
The token for bearer token authentication.