About data integration with connectors
Connectors enable bidirectional data integration between source systems and Cognite Data Fusion (CDF) as part of the data integration workflow. You can integrate data with prebuilt Cognite connectors or create a custom connector using Python and .NET utilities packages and SDKs.
The prebuilt connectors can stream or sync data bidirectionally between source systems and the CDF staging area or directly to a CDF service with little or no data transformation.
Connectors maintain data consistency between source systems and CDF through controlled read and write operations, with appropriate access permissions for bidirectional synchronization.
Cognite connectors
| Connector | Description |
|---|---|
| PROSPER connector | Integrates with the PETEX PROSPER simulator to create process twins for wells and pipelines in CDF. Run multiphase flow simulations with direct data exchange between PROSPER and CDF. |
| GAP connector | Integrates with the PETEX GAP simulator to create process twins for production and injection networks in CDF. Run steady-state network modeling and optimization with direct data exchange between GAP and CDF. |
| Fabric connector | Integrates with Microsoft Fabric to replicate time series, events, data models, and RAW tables from CDF to Fabric, and extracts time series, events, and files from Fabric to CDF. This connector supports bidirectional data exchange between the two platforms through dedicated replication services. |
| PostgreSQL gateway | Ingests data into CDF from ETL tools. This service provides a PostgreSQL interface to CDF and the CDF resource types appear as tables in the PostgreSQL database. |
| SAP write-back | Creates or updates records in your SAP S/4HANA system. |
Download installation files
- Navigate to the Data management workspace > Integrate > Extractors.
- Use the search bar to filter the list of data integration services and select the connector best suited to your integration needs.
- Download the Installation file and, optionally, the PDF documentation.
Custom connectors
You can create custom connectors if your integration requirements can't be met by the prebuilt connectors.
Cognite Python extractor-utils
Use the Python extractor-utils, an extension of the Cognite Python SDK, to develop extractors in Python. For more information, see the Python extractor-utils SDK documentation.
Cognite .NET extractor-utils
Use the .NET extractor-utils to develop extractors in C#. For more information, see the .NET utils documentation.
Cognite .NET simulator-utils
Use the .NET simulator-utils to develop simulator connectors in C#. For more information, see the .NET utils documentation.