Azure synapse analytics there are showing but not able to find the exact resource
We are seeing that azure synapse upgrade in the query but it is not showing any resource name, could you please help how to find the exact resource
Azure Synapse Analytics
How to publish Synapse workspace with Pull Request generated
We are using Git integration to publish workspaces templates to workspace_publish branch. We recently received S360 item regarding the commitWithoutPullRequest voliation from AzDO Production Readiness Check. Please suggest how to generate PR for the git…
Azure Synapse Analytics
How to fix - Error: The resource type 'Microsoft.Synapse/workspaces/kustoPools' is not found.
Hi Team, We are suddenly encounter error "Error: The resource type 'Microsoft.Synapse/workspaces/kustoPools' is not found." in our workspace.No configuration changes have been made on our end Please guide us to resolve this issue
Azure Synapse Analytics
more frequent “insufficient resource” errors when starting new notebook sessions
We observed more frequent “insufficient resource” errors when starting new notebook sessions in our West US 2 workspace. In these cases, the notebook start-up hangs for several hours, while the pipeline status wasshow “In Progress” instead of failing. …
Azure Synapse Analytics
How to fix Azure Synapse Linked Service TCPS SSL Handshake Failure to Oracle Database via Self-Hosted Integration Runtime ?
We are experiencing an SSL handshake failure when testing a connection from Azure Synapse Analytics to an Oracle Database over TCPS using a Self-Hosted Integration Runtime (SHIR). The Oracle database listener is configured for TCPS, and the server…
Azure Synapse Analytics
How to download files(>4mb) USING copy activity from REST END POINT in synapse.
I am trying to download files from REST end points using a) web activity for token generation and passing token to copy activity. b) copy activity for downloading the files. source is BINARY and sink is binary. I am able to download the file sizes up…
Azure Synapse Analytics
Dedicated SQL Pool is taking a long time scale up and down
Dedicated SQL pool is taking 20 - 30 minutes to scale up and down. Average time prior to Jan 16 was 10 minutes or less. This is impacting production performance. As a side note, we had this issue last year and it was resolved. What was fixed seems to…
Azure Synapse Analytics
Synapse Mapping Data Flow Sink creates unexpected empty 0-byte files when writing Parquet to Azure Blob Storage
Issue Summary : When using Azure Synapse Analytics Mapping Data Flow to write an updated Parquet file from one Blob Storage container to another, the Sink creates: The expected Parquet file inside the correct folder structure : …
Azure Synapse Analytics
Script run failed in synapse notebook to read data from CosmosDB when upgrade to spark pool 3.5
script run failed when upgrade to spark pool 3.5 with the script below: df = spark.read.format("cosmos.olap")\ .option("spark.synapse.linkedService", linkservice)\ .option("spark.cosmos.container",…
Azure Synapse Analytics
Issue: [REDACTED] appears in CSV column names in Azure Synapse (ACC only)
We observe inconsistent behavior between environments when reading CSV files from ADLS Gen2 in Azure Synapse Analytics (Spark). In TST, column names are read correctly, for example: MYS Work Type To Invoice$77889ad3-1296-4344-a858 In ACC only, parts of…
Azure Synapse Analytics
Azure Synapse link tables stuck in a "Queued" or "Initial sync in progress" status when syncing to Azure storage. How can I fix these tables to sync fully?
HI, I have set up Azure Synapse link (for Finance and Operations) and successfully sync'd a number of tables to my Azure Storage account. Some, not all, tables are stuck in a "Queued" or "Initial sync in progress" status when…
Azure Synapse Analytics
Access Control in Synapse Dedicated SQL Pool and Impact of Notebooks
Hello, I am looking for some critical information related to data security aspect within the Synapse. Below is our current scenario, We have a Synapse dedicated sql pool in the production environment. The dedicated sql pool has multiple schemas of which…
Azure Synapse Analytics
Multi process inbound file ingestion process
Hello, I am looking for some pipeline design recommendations. We have multiple process (20+) that are currently being reviewed for migration to Synapse. These process are based on inbound files and once the files are processed to the data lake store or…
Azure Synapse Analytics
Synapse failure with Internal error
Hello - We have two days our processes on Synapse analytics is failing with internal error. Is failing to extract data from Oracle OCI. This is the error message: "Operation on target FA-DWH-MAIN-FLEXCUBE failed: Operation on target FA-DWH-MAIN…
Azure Synapse Analytics
Azure Synapse Notebook Fails To Find Imports From Jars (Spark 3.5)
So I loaded in the custom jar into the session: %%configure -f { "conf": { "spark.jars":"abfss://******@myplace.dfs.core.windows.net/test/test_2.12-0.1.0-SNAPSHOT.jar" } } After loading I attempt to…
Azure Synapse Analytics
allocated vcores but not application or user allocated
After running pipelines in Synapse the monitoring shows that the cores are allocated, although the same monitoring is not indicating any detail allocations or applications running or using the cores. Because of this I cannot run notebooks in another…
Azure Synapse Analytics
SQL server slowness
Dear Team, We have been experiencing significant slowness in query execution starting from December 22. Previously, the affected queries (simple SELECT statements on views) would complete within 2–3 minutes, but now they are taking over an hour to…
Azure Synapse Analytics
What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse
Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.
Azure Synapse Analytics
Azure Databricks
Azure Data Factory
Configuring Data Source for Azure Synapse Serverless SQL Pool in Azure AI Search
Hi Team, I am trying to add a Synapse serverless SQL pool database as a data source for indexing in Azure AI Search, utilizing managed identity for authentication between services. The following prerequisites have been completed: Azure AI Search's…
Azure AI Search
Azure Synapse Analytics
When will Azure Backup Support for HNS be available?
Hi, I was trying to implement Azure vaulted backup using the article https://learn.microsoft.com/en-us/azure/backup/blob-backup-overview?tabs=operational-backup. Unfortunately, I discovered that “HNS-enabled storage accounts are currently not supported.…