Slack Weekly Digest 2024-03 #34412
marcosmarxm
announced in
Slack Weekly Digest
Slack Weekly Digest 2024-03
#34412
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This is weekly digest of discussions happened in the Airbyte Slack.
Connector Discussions
This week, Airbyte users encountered a range of issues spanning connectors such as MongoDB Atlas to BigQuery, BigQuery to Clickhouse, Monday.com, and more. Problems include synchronization errors, connection issues, slow data retrieval, and specific errors like the Log4j method not found. These challenges reflect the diverse complexities users face across various data integration scenarios.
custom-connector] Custom Connector Fails with 'Activity task failed' for Specific API Key on Airbyte Cloudnormalization] Job Freezing at Normalization Step with Custom Columns in Created Tabledestination-postgres, normalization] Slow Normalization and DBT Transformation with Aurora RDS Connector - Concurrency Delaysource-amazon-seller-partner] Error 500 - Unexpected Problem inamazon-seller-partnerConnector duringintiateSourceAPIsource-amazon-seller-partner] OAUTH Issues (Missing Refresh Token) - Amazon Seller Partner Connector - Airbyte Cloudsource-amazon-sqs] Issue with Amazon SQS Connector: Incomplete Data Retrieval when Delete Messages After Read is FALSEsource-bigquery, destination-clickhouse] Bigquery to Clickhouse Connector - Connection Errorsource-facebook-marketing] Permission Handling for Facebook Marketing API Connector - Seeking Guidance on Replicating User Experience and Screencastsource-facebook-marketing] Facebook Marketing to S3 Sync Fails with Heartbeat Timeoutsource-google-cloud-storage] Trouble with GCS Source Connector - Glob Patterns Not Matching Files in Subfoldersource-hubspot] HubSpot Connector - Incomplete Record Sync Issuesource-klaviyo, destination-bigquery] Slow Historical Sync for Klaviyo to BigQuery Connector - Sequential Fetching Detectedsource-monday] Monday.com Connector - Selective Board Data Extraction Issuesource-mongodb, destination-bigquery] Error during second sync from MongoDB Atlas to BigQuery: "java.lang.RuntimeException: com.fasterxml.jackson.core.exc.StreamConstraintsException"source-mssql] Issues with MSSQL Connector and CDC Feature for Table Data Retrievalsource-mysql] MySQL CDC Binlog Syncing Fails After Initial Incremental Syncs in Airbyte v0.50.43source-mysql, destination-icerberg] Error in MySQL to Iceberg (S3) Replication Process on AWS EC2 - Log4j Method Not Found"source-netsuite] Customizing NetSuite Source URL for SuiteQL Queries in Airbyte Integrationsource-postgres] Slow WAL Search during PostgreSQL CDC Syncsource-postgres] Index Replication Not Working for Postgres-to-Postgres Connectorsource-postgres, destination-bigquery] Error withtxid_snapshot_xmin()persisting in BigQuery destination using CockroachDB as a source with User Defined Cursorsource-postgres, destination-bigquery] Postgres to BigQuery Connector - Sync Fails with 'No space left on device' Errorsource-postgres, destination-postgres, normalization] Normalization Process Fails with Exec Format Error during Sync Test between Two PostgreSQL Databasessource-s3] S3 Source Sync Breaks Stream on File Update during Full Refreshsource-shopify, destination-bigquery] JSON output instead of nested fields in BigQuery destination V2 for Shopify sourcesource-slack] Slack Connector: Need Guidance on Increasing Rate Limitsource-typeform] Partial Sync Issue: TypeForm to BigQuery Connector with Jinja2 Error (list object has no element -1)source-zoho-crm] Error Connecting Zoho CRM to Snowflake: Invalid isoformat string '2024-01-01T00:00:00Z'Platform Discussions
Issues reported include connection problems between Airbyte DB and Cloud SQL, SSL-related errors with airbyte-temporal, missing Docker images, scheduler and job failures, discrepancies in sync processes, workspace creation errors, and configuration troubles with connectors. Users are experiencing a variety of challenges, reflecting the complexity of their setups.
deploy, external-db, cloud-gcp-sql] Failed Connection Between Airbyte DB and Cloud SQL, Bootloader Stuck, Temporal Restart Loopdeploy, temporal, external-db] airbyte-temporal Service Fails to Connect to PostgreSQL with SSL – Namespace Default Initialization Errormissing-containers] Missing Docker Image 0.50.43 for airbyte/workload-api-server in Docker Hubterraform] Querying with Terraform-based Connector and Implementing Where Clause in Airbytemigrated-instance, external-db] Scheduler Not Triggering Automatically After EC2 Replacement in Docker Compose Deploymentserver] Unable to Reach Sources or Destinations, Jobs Stuck, and Cancel Button Not Workingsync] Clarification on Emitted and Committed Records Discrepancy in Sync Processworkspace] Error Creating Workspace: Seeking Assistance and Connector Informationnotification] Configuring PagerDuty Notifications for Failed Sync Jobs in Airbyte Docker-compose Setupapi] Unable to Obtain Access Credentials for Powered by Airbyte Offering from Self-Deployed Airbyte on Kubernetesoperations] Clarification on Transformation Phase Using Only dbt in Airbytehelm, external-logs] Configuration Troubles with External Non-AWS S3 Logs and State Store (Kubernetes)helm, auth] WebUI Authentication not Prompting in Airbyte on EKS with Helm Chart"kubernetes, worker] NullPointerException during Sync: Upgrade from Airbyte 0.50.33 to 0.50.43 with Helm Chart 0.50.21audit-logs] Request for UI User Action Audit Logs in Kubernetes Deploymentapi] Need Configuration Option for Automatic Truncation of Connector Job Historydeploy, helm, aws-eks, aws-alb] 403 Forbidden Error when Saving Connection behind AWS ALB in EKSapi] Handling Multiple API Endpoints for Single Stream in Airbyte CloudBeta Was this translation helpful? Give feedback.
All reactions