Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
1 answer
One of the answers was accepted by the question author.
Microsoft Graph Data Connect App Registration Issue
How do you now create a Microsoft Graph Data Connect app registration? For context we had one working for over a year. And we tried to update the scope to add one AD Gorup to the scope, and it wasn't working. So we removed that app registration, and now…
Azure Data Factory
asked 2025-08-04T15:09:53.66+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 87%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETT%3C/text%3E%3C/svg%3E)
Trent Tamura
20
Reputation points
commented 2026-02-03T20:44:40.7166667+00:00
Trent Tamura
20
Reputation points
2 answers
MERGE pre-copy script keeps giving unique constraint violation
I'm using ADF to move (copy activity) a .csv file into a z/OS DB2 table. The sink data set is an ODBC linked source to DB2. The .csv file is processed in a data flow and loaded into a DB2 staging table. I'm using the pre-copy script to merge the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 46%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
2 answers
[Azure Data Factory] Data Flow Sink is extremely slow
I'm copying about 800 items from SAP to Azure Fabric. I'm running pipeline with data flow in Azure Data Factory (ADF). We are using Self-hosted integration runtime. The Data Flow is not complex, it just copies data and adds an additional column. There…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-02-02T16:10:32.27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 68%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
Hanna Melashkina
0
Reputation points
commented 2026-02-03T10:09:23.48+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Cross-tenant Azure SQL Database schema sync and data copy using pipelines from a single tenant
I have the following scenario and would like guidance on feasibility and best practices. Scenario: I have one Azure SQL Database in my tenant. I need to sync with another Azure SQL Database in a client’s tenant. Both databases have the same schema…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-20T09:21:40.2666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 91%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFR%3C/text%3E%3C/svg%3E)
Faisal Riaz
120
Reputation points
accepted 2026-02-03T09:46:31.2666667+00:00
Faisal Riaz
120
Reputation points
1 answer
Is there a parquet file size limit for loading files using Azure
We are using an ADF pipeline to load a parquet file into a database table. On Friday the data file size was 16,384 KB. On Saturday and this morning, the file size is now 16,387 KB. The data file is a full copy of data from another system. Any…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-02-02T20:24:06.2866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 24%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELD%3C/text%3E%3C/svg%3E)
Laurent Delaquis
0
Reputation points
answered 2026-02-02T20:27:20.6133333+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
1 answer
Copy Data cannot delete files from SFTP
Hi, I'm using the copy data activity with a wildcard filter to move *.csv files from one sftp server to another. My pipeline works fine until I activate "Delete files after completion". I then get the following error…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-28T12:45:39.14+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 61%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Manuel Tospann
296
Reputation points
commented 2026-02-02T20:17:58.0233333+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
2 answers
Tumbling Window Trigger with Dependencies and 5 min and 10 min delay after Dependencies completed
I have a 2 Tumbling Window Triggers TW1 and TW2 and these have no dependencies between them. TW1 starts run at morning 7 AM, TW2 starts run at morning 7:10 AM. Both can take between 30 minutes to 4 hr for completion. I have another two Tumbling Window…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-29T20:36:25.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 59%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIN%3C/text%3E%3C/svg%3E)
Immaneni, Nanda
35
Reputation points
commented 2026-02-02T04:18:12.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 18%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
VRISHABHANATH PATIL
5,175
Reputation points Microsoft External Staff
Moderator
2 answers
ADF CSV output quoting behavior changed without configuration change, breaking downstream BigQuery loads
Hi Microsoft Team, We are facing an issue where an existing Azure Data Factory pipeline started producing CSV files with different quoting behavior without any configuration changes. The ADF pipeline, dataset, linked services, and integration runtime…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-28T15:48:32.4266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 88%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPK%3C/text%3E%3C/svg%3E)
Pavithra Kumaravelu
0
Reputation points
commented 2026-02-02T04:15:51.7033333+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
2 answers
How to ingest data to Azure using ODBC software(.exe) application
Hi, I am new to Azure, so please bear with me. We have a on prem sql server and we download data from our provider using a ODBC connection i.e. we have a software that we need to install on the server and use SSIS to download the data from the source to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-26T09:40:58.2066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 55.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
prime prime
0
Reputation points
commented 2026-02-02T04:11:25.7233333+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
7 answers
One of the answers was accepted by the question author.
Unable to download Purview exports
Hello I have tried to download the export packages from the ediscovery menu. I have tried on mac & linux Edge and firefox browsers. When I push the download button, nothing happens. The close button does work. Is there another way to access these…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2025-03-03T07:21:08.6833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 10%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECL%3C/text%3E%3C/svg%3E)
Christopher Lowden
225
Reputation points
answered 2026-01-31T01:40:41.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 76%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
Matthew Beechey - Mobius
6
Reputation points
2 answers
What is the recommended migration path now that Memory Optimized Data Flows are being retired in Azure Data Factory?
Dear Team, I received the notice that Memory Optimized Data Flows are being retired and that I should transition to General Purpose Data Flows. Could someone explain: What are the key differences between Memory Optimized and General Purpose Data…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-28T08:44:25.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 54%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Sushil Himmatrao Chaudhari
0
Reputation points
commented 2026-01-29T07:25:37.37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
33,110
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Can ADF use a SQL generated correct JSON object and write directly to a Cosmos container with no mapping?
Using SQL stored procs, I can generate legal JSON objects, many of which contain internal objects and arrays; sometime these are nested. I want to use these stored procs as the Source in an ADF pipeline Copy block. How can I use ADF to write these…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-28T23:30:19.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 82%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKV%3C/text%3E%3C/svg%3E)
Kurt von Nieda
21
Reputation points Microsoft Employee
answered 2026-01-29T00:29:21.3833333+00:00
VRISHABHANATH PATIL
5,175
Reputation points Microsoft External Staff
Moderator
1 answer
Unable to Connect Azure Data Factory to Azure SQL Database Using Managed Identity
Hi, I am experiencing persistent connectivity issues between my Azure Data Factory (ADF) and Azure SQL Database using System-assigned Managed Identity. Despite following the recommended steps. Verified linked service configuration (server, database) …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-26T20:26:16.8866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 7.000000000000001%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
Yuvaraj M
0
Reputation points
commented 2026-01-28T00:44:19.7633333+00:00
VRISHABHANATH PATIL
5,175
Reputation points Microsoft External Staff
Moderator
2 answers
Couldn't launch Azure Data Factory
Hi, I couldn't launch Azure data factory since this morning. It prompted 'loading' for almost 1 hour. Other Azure are working. Anyone know what happened? Regards, Bo X
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-22T21:53:15.22+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 40%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBX%3C/text%3E%3C/svg%3E)
Bo Xiao
76
Reputation points
commented 2026-01-27T17:01:39+00:00
VRISHABHANATH PATIL
5,175
Reputation points Microsoft External Staff
Moderator
2 answers
How to Load Hierarchical JSON with Nested Arrays into Azure SQL Using Only ADF Copy Activity
Hi all, I’m trying to load hierarchical JSON data into Azure SQL using only Copy Activity in Azure Data Factory (ADF). The JSON structure is like this: Account_Id at the root level data[] array containing ad metrics (ad_id, clicks, impressions, spend,…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-01T12:39:37.48+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 57.00000000000001%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYS%3C/text%3E%3C/svg%3E)
YERNAIDU SIRAPARAPU
125
Reputation points
edited the question 2026-01-27T14:04:34.6433333+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
2 answers
Azure Data Factory Pipeline error 429
Hello there, I am using since a few years now Azure Data Factory to pull out data from MS Graph and lately this year at the start of the year, I keep getting error 429. That means that my automatic requests from ADF pipeline, I keep get most of my…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-20T16:05:41.4933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 77%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGC%3C/text%3E%3C/svg%3E)
Gherghinel, Cristian
0
Reputation points
commented 2026-01-27T05:41:01.53+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
3,135
Reputation points Microsoft External Staff
Moderator
2 answers
DWCopyCommandOperationFailed
Why do I keep getting this error. I think I have checked all permissions, but I can't seem to resolve it. ErrorCode=DWCopyCommandOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message='AzureSqlDW' Copy Command…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-26T14:16:31.2433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 63%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
Dana Brooks
0
Reputation points
answered 2026-01-26T14:27:36.9466667+00:00
Manoj Kumar Boyini
5,410
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse
Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,569 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,822 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 13%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
ADF deployment using ARM
Helllo, Can we deploy ADF using ARM templates ? Thanks Himanshu
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-16T06:05:01.6033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
HimanshuSinha
19,567
Reputation points Microsoft Employee
Moderator
accepted 2026-01-23T18:25:58.8833333+00:00
HimanshuSinha
19,567
Reputation points Microsoft Employee
Moderator
1 answer
Azure Data factory for Jira via REST API not working
Hi, I'm using Azure data factory to get Jira issue data via REST API. The linked service type is REST, authentication type is Basic. It's a weekly job, the last succussed job was January 15th 2026. In this morning, the job was succussed but it returned…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,048 questions
asked 2026-01-21T21:58:42.2066667+00:00
Bo Xiao
76
Reputation points
commented 2026-01-22T21:16:19+00:00
VRISHABHANATH PATIL
5,175
Reputation points Microsoft External Staff
Moderator