Skip to main content

Data Factory

Planned

Support for custom connectors in Dataflow

Vote (86) Share
Derek's profile image

Derek on 31 Mar 2019 14:45:54

Allow custom connectors developed for rest APIs/ODBC to be used the same way how they can be in PBI services. This would open much more opportunity for dataflow service to be used as a "data warehouse like" environment.

Administrator on 24 May 2024 15:40:24

We are aiming to have this for Q1 of 2025.

Note that timelines might be subject to change.

Comments (16)
Derek's profile image Profile Picture

James on 06 Jul 2020 00:08:08

RE: Support for custom connectors in Dataflow

As our business analysts are becoming more adept at preparing data with Power Query "M" scripts, we are finding that collaborators want to be able to reuse the results in products besides PowerBI Desktop. It would help to have ODBC driver support to allow other analysts the ability to query the dataflow in the tool of their choice. Not all organizations have the ability to configure their own Azure Data Lake Storage or the expertise to expose the content of the Common Data Model in a business analyst friendly way. That could also help to address another idea for allowing Excel to connect to Dataflows until a native connector could be made available within the Office client.

Derek's profile image Profile Picture

Power BI User on 06 Jul 2020 00:03:51

RE: Support for custom connectors in Dataflow

This really would open up the possibilities of the work that can be done in dataflows. I have a custom connector which pulls data from an API. I am wanting to stage historical data in a dataflow to set different refresh schedules against each stage, therefore I don't need to pull the lifetime data from the API, which is hitting my API call limit.

Derek's profile image Profile Picture

David on 05 Jul 2020 23:53:53

RE: Support for custom connectors in Dataflow

Please add support for Google BigQuery to Dataflows.

Derek's profile image Profile Picture

Danilo Cisneros on 05 Jul 2020 23:49:07

RE: Support for custom connectors in Dataflow

ODBC Connector for Dataflows

Derek's profile image Profile Picture

Ruben on 05 Jul 2020 23:44:45

RE: Support for custom connectors in Dataflow

Please add a Google BigQuery connector for Dataflows.

Derek's profile image Profile Picture

Yan on 05 Jul 2020 23:39:29

RE: Support for custom connectors in Dataflow

Please add BigQuery as online data source, with native API calls to leverage Cloud-to-Cloud transfers.

Current workaround is cumbersome and inefficient as result data flows through locally: Dataflows ODBC data source -> Gateway to Simba's ODBC driver -> records from BigQuery.