Skip to main content

Use Copy Into

When enabled, notebooks will use COPY INTO to read files instead of CREATE OR REPLACE TEMPORARY VIEW SQL syntax.

With the default N, landing files are read through a temporary view over read_files(...), using the generated Read Files Options. With Y, the load creates a staging table and ingests the files with COPY INTO, using the generated FORMAT_OPTIONS (Copy Format Options) and COPY_OPTIONS (Copy Options) clauses.

When to Change This Setting​

Keep the default N for the lighter temporary-view read. Enable it when you want the files materialized through Databricks COPY INTO and its options instead.

SettingInteraction
Copy Format OptionsOverrides the FORMAT_OPTIONS clause of the generated COPY INTO
Copy OptionsOverrides the COPY_OPTIONS clause of the generated COPY INTO
Read Files OptionsOverrides the read_files options of the temporary-view pattern
Use Temporary ViewsControls the broader temporary-view load pattern this setting interacts with

Notes​

  • This setting is part of the Databricks settings category.
  • The default value for this setting is N.