Yes, using wildcards like /year=*/month=*/day=* for Parquet or CSV formats. For the string pushdown, you need to use Latin1_General_100_BIN2_UTF8 collation on the VARCHAR columns to enable pushdown. Use Delta partitioned views if you need to query partitioned Delta Lake data. Do not create external tables on Delta Lake folders because they are not supported.
You might create external tables on Parquet partitioned folders, but the partitioning columns will be inaccessible and ignored, while the partition elimination will not be applied. Partition elimination is available only in the partitioned tables created on Parquet or CSV formats that are synchronized from Apache Spark pools. Serverless SQL pool: Delimited/CSV, Parquet, and Delta Lake Dedicated SQL pool: Parquet (preview) Only Parquet tables are available in public preview.ĭelimited/CSV, Parquet, ORC, Hive RC, and RC The key differences between Hadoop and native external tables are presented in the following table: External table type Native external tables are available in serverless SQL pools, and they are in public preview in dedicated SQL pools. Native external tables that you can use to read and export data in various data formats such as CSV and Parquet.Hadoop external tables are available in dedicated SQL pools, but they aren't available in serverless SQL pools. Hadoop external tables that you can use to read and export data in various data formats such as CSV, Parquet, and ORC.With Synapse SQL, you can use external tables to read external data using dedicated SQL pool or serverless SQL pool.ĭepending on the type of the external data source, you can use two types of external tables:
External tables are used to read data from files or write data to files in Azure Storage. An external table points to data located in Hadoop, Azure Storage blob, or Azure Data Lake Storage.
0 kommentar(er)
