Skip to main content

BigQuery Denormalized

See destinations/bigquery

Changelog

bigquery-denormalized

VersionDatePull RequestSubject
1.5.32023-07-14#28345Increment patch to trigger a rebuild
1.5.22023-07-05#27936Internal code change
1.5.12023-06-30#27891Revert bugged update
1.5.02023-06-27#27781License Update: Elv2
1.4.12023-05-17#26213Fix bug in parsing file buffer config count
1.4.02023-04-28#25570Fix: all integer schemas should be converted to Avro longs
1.3.32023-04-27#25346Internal code cleanup
1.3.02023-04-19#25287Add parameter to configure the number of file buffers when GCS is used as the loading method
1.2.202023-04-12#25122Add additional data centers
1.2.192023-03-29#24671Fail faster in certain error cases
1.2.182023-03-23#24447Set the Service Account Key JSON field to always_show: true so that it isn't collapsed into an optional fields section
1.2.172023-03-17#23788S3-Parquet: added handler to process null values in arrays
1.2.162023-03-10#23931Added support for periodic buffer flush
1.2.152023-03-10#23466Changed S3 Avro type from Int to Long
1.2.142023-02-08#22497Fixed table already exists error
1.2.132023-01-26#20631Added support for destination checkpointing with staging
1.2.122023-01-18#21087Wrap Authentication Errors as Config Exceptions
1.2.112023-01-18#21144Added explicit error message if sync fails due to a config issue
1.2.102023-01-04#20730An incoming source Number type will create a big query integer rather than a float.
1.2.92022-12-14#20501Report GCS staging failures that occur during connection check
1.2.82022-11-22#19489Added non-billable projects handle to check connection stage
1.2.72022-11-11#19358Fixed check method to capture mismatch dataset location
1.2.62022-11-10#18554Improve check connection method to handle more errors
1.2.52022-10-19#18162Improve error logs
1.2.42022-09-26#16890Add user-agent header
1.2.32022-09-22#17054Respect stream namespace
1.2.22022-09-14#15668(bugged, do not use) Wrap logs in AirbyteLogMessage
1.2.12022-09-10#16401(bugged, do not use) Wrapping string objects with TextNode
1.2.02022-09-09#14023(bugged, do not use) Cover arrays only if they are nested
1.1.162022-09-01#16243Fix Json to Avro conversion when there is field name clash from combined restrictions (anyOf, oneOf, allOf fields)
1.1.152022-08-03#14784Enabling Application Default Credentials
1.1.142022-08-02#14801Fix multiple log bindings
1.1.132022-08-02#15180Fix standard loading mode
1.1.122022-06-29#14079Map "airbyte_type": "big_integer" to INT64
1.1.112022-06-24#14114Remove "additionalProperties": false from specs for connectors with staging
1.1.102022-06-16#13852Updated stacktrace format for any trace message errors
1.1.92022-06-17#13753Deprecate and remove PART_SIZE_MB fields from connectors based on StreamTransferManager
1.1.82022-06-07#13579Always check GCS bucket for GCS loading method to catch invalid HMAC keys.
1.1.72022-06-07#13424Reordered fields for specification.
1.1.62022-05-15#12768Clarify that the service account key json field is required on cloud.
0.3.52022-05-12#12805Updated to latest base-java to emit AirbyteTraceMessage on error.
0.3.42022-05-04#12578In JSON to Avro conversion, log JSON field values that do not follow Avro schema for debugging.
0.3.32022-05-02#12528Update Dataset location field description
0.3.22022-04-29#12477Dataset location is a required field
0.3.12022-04-15#11978Fixed emittedAt timestamp.
0.3.02022-04-06#11776Use serialized buffering strategy to reduce memory consumption.
0.2.152022-04-05#11166Fixed handling of anyOf and allOf fields
0.2.142022-04-02#11620Updated spec
0.2.132022-04-01#11636Added new unit tests
0.2.122022-03-28#11454Integration test enhancement for picking test-data and schemas
0.2.112022-03-18#10793Fix namespace with invalid characters
0.2.102022-03-03#10755Make sure to kill children threads and stop JVM
0.2.82022-02-14#10256Add -XX:+ExitOnOutOfMemoryError JVM option
0.2.72022-02-01#9959Fix null pointer exception from buffered stream consumer.
0.2.62022-01-29#9745Integrate with Sentry.
0.2.52022-01-18#9573BigQuery Destination : update description for some input fields
0.2.42022-01-17#8383BigQuery/BiqQuery denorm Destinations : Support dataset-id prefixed by project-id
0.2.32022-01-12#9415BigQuery Destination : Fix GCS processing of Facebook data
0.2.22021-12-22#9039Added part_size configuration to UI for GCS staging
0.2.12021-12-21#8574Added namespace to Avro and Parquet record types
0.2.02021-12-17#8788BigQuery/BiqQuery denorm Destinations : Add possibility to use different types of GCS files
0.1.112021-12-16#8816Update dataset locations
0.1.102021-11-09#7804handle null values in fields described by a $ref definition
0.1.92021-11-08#7736Fixed the handling of ObjectNodes with $ref definition key
0.1.82021-10-27#7413Fixed DATETIME conversion for BigQuery
0.1.72021-10-26#7240Output partitioned/clustered tables
0.1.62021-09-16#6145BigQuery Denormalized support for date, datetime & timestamp types through the json "format" key
0.1.52021-09-07#5881BigQuery Denormalized NPE fix
0.1.42021-09-04#5813fix Stackoverflow error when receive a schema from source where "Array" type doesn't contain a required "items" element
0.1.32021-08-07#5261🐛 Destination BigQuery(Denormalized): Fix processing arrays of records
0.1.22021-07-30#5125Enable additionalPropertities in spec.json
0.1.12021-06-21#3555Partial Success in BufferedStreamConsumer
0.1.02021-06-21#4176Destination using Typed Struct and Repeated fields