Release notes

This article documents the ongoing releases of Cognite Data Fusion (CDF) features and products.

December 2024

These features will become available on December 3, 2024.

New and updated features

Cognite Data Fusion

Cognite Atlas AI agents extend CDF with a workspace to create and manage industrial AI agents to solve your specific business needs. Cognite provides example agent templates that you can use as a starting point for building your agents, or you can use our low-code tools to build agents from scratch.

Atlas AI agents use generative AI (genAI) language models and include prompts with instructions and goals, industry-relevant tools, and access to industrial data stored in your CDF knowledge graph. Humans set the goals, and the AI agent chooses the best actions to take to achieve those goals. (Early adopter)

In the Industrial tools workspace

Search is now the only option for finding data in the Industrial tools workspace and replaces the Data explorer. Search covers the same features as the Data explorer, as well as some features that are unique to search. In this release, search is updated with:

• Explore charts or canvases under Solutions in the search sidebar. On the search details page, you'll find the Appears in section if the data you've queried appears on a canvas.

• See data that are directly and indirectly linked on a separate card in the search results.

• Sort documents by their category, such as P&IDs or data sheets. Open the File tab in search, Canvas, or Charts and select View categories.

  • If you're using asset-centric data modeling, the document categories are based on NORSOK's categorization rules. CDF sorts by the doc_type metadata and if this metadata doesn't exist, CDF sorts by title. If this doesn't match, the documents are placed within a Not categorized section.

  • If you're using core data modeling, CDF sorts by the CogniteFileCategory property.

• If you're browsing 3D models, you can open a 3D scene or a specific 3D model. Select Ghost mode to gray out areas that are out of focus for your work. In 3D scenes, insert points of interest, add comments, and share the link to the point of interest with your coworkers. CDF stores the camera position, the clipping planes, the linked asset, and the coordinates. Under Settings, you'll find new options for visualization controls:

  • Adjust image transparency to reveal structures.
  • Hide all markers or hiding markers blocked by objects in front of you.
  • Navigate between previously viewed 360° images using the arrows in the top toolbar.

To continue using Data explorer, navigate to the Data management workspace. If you've bookmarked the Data explorer, you'll see a message to redirect to the Data explorer or to search.

On the Canvas, select Extract pages from the toolbar above a document to extract all or specific pages from the document and add these to a canvas. If you're downloading a canvas as a PDF file, you can select which document pages to include. If you're working with time series on a canvas, you can toggle between viewing the time series data as a graph or as values. Select Change to value view from the toolbar above a time series. Note that you can also add links to a canvas or any item on a canvas, such as in a sticky note or as a text comment.

In the Data management workspace

• Set up simulator integrations to connect first-principle simulation tools and CDF. Simulation integrations can be used for real-time asset performance optimization, predictive maintenance, what-if scenario analysis, and digital twin development.

  Use the Cognite API to create simulation workflows and the CDF interface to manage simulation resources and explore simulation results. We provide out-of-the-box connectors to industry-standard simulator tools.

  Build data workflow tasks that interact with the simulator integration routines and enable automated, repeatable simulation workflows for data transfers between CDF resources and simulations.

• Use the Diagram parsing tool to analyze engineering diagrams to extract information. This tool automatically detects and maps asset and file tags to CDF resources. For files with SVG elements, Diagram parsing identifies symbols, lines, and connections, and builds a knowledge graph in CDF. You can review and verify the automatic mappings as part of the process. (Beta)

• When you're contextualizing 3D objects, use the unified 3D contextualization editor for CAD, point clouds, or 360° images. You'll see context for a scene and can locate specific structures, such as identifying where a 360° image is positioned in the scene or determining which equipment a point cloud represents. The 360° image contextualization now also support data modeling. You can mark images and link them to assets using the resource selector.

  The automatic tag detection now processes all 360° images, and generates suggestions for discovered tag numbers. You can review these suggestions, link them to assets if correct, edit incomplete tags, or discard incorrect suggestions.

• In Data workflows, scope access to specific data sets and set up event-based triggers to automate workflows based on data changes. (Beta)

• For Transformations that require full table-reads, you can read content from CDF Files in NDJSON format by referencing the file in an SQL statement. This is an alternative to using the CDF staging area for transformations where increamental loading (is_new) isn't possible.

• Cognite Functions can now be used on CDF projects running in an Amazon Web Services (AWS) cluster.

• We're introducing a new Cognite connector to allow write-back for a bidirectional flow of SAP notification and attachment data between SAP S/4HANA and CDF. The Cognite SAP extractor now allows OData v2 or the OData v4 SAP S/4HANA endpoints to ingest SAP data to CDF.

  Copilot for documents and the Azure Event Hub and REST API extractors have now been released into general availability.

Resolved issues and minor updates

• Download files from the Files tab in search.

• Search and filter data when you've sorted the data in a tree view on the search results page.

• We've improved the performance on a canvas and reduced the load time for large or multiple documents.

• CDF now keeps your language setting if you switch to another PC or device.

• The sidebar on the CDF home page is collapsible and has improved prompts to help you remember to close it when doing focused work.

InField

• Fixed issue where a numerical reading would disappear after the task state was set.
• Fixed issue with duplicating the groups with the same name when switching between templates. The group names must be unique.
• Fixed issue where it was impossible to switch between locations as the data storage limit was reached.
• Fixed issue where the changes for one checklist item wouldn't be saved if you created the second checklist item too quickly.
• Fixed issue where changing the task state removed the attached media from the task.
• Fixed issue where changes to the time series minimum and maximum values weren't autosaved.
• Fixed issue where users weren't able to see the number of activities completed in a group.
• Fixed issue where the automatically created checklists were scheduled at the wrong time.
• Fixed issue where InField would stop responding when opening work orders on the asset details page.

Cognite API updates

See the API changelog.

Deprecated and retired features

See Deprecated and retired features.

September 2024

New and updated features

Cognite Data Fusion

We've simplified how you sign in and navigate in CDF. When you sign in, you can enter an organization name or select an organization you recently signed in to. When you open a CDF tool, a breadcrumb trail is displayed. On some breadcrumbs, there'll be a dropdown list with common actions, such as creating and deleting items.

In the Industrial tools workspace

• Ask Cognite Copilot to help you find answers across multiple documents. This feature is optimized for finding answers in PDF files with text. Copilot can search a maximum of 100 documents. This feature is available on Canvas and on the details page when you've searched for data.

• Previously, the Data explorer was the default search engine in the Industrial tools workspace. With this release, the search tool is the default search engine. To keep the Data explorer as your default search engine, select Open Data explorer in the top bar banner. Notice how the menu item in the sidebar switches names.

  This adjustment aligns with the upcoming solution where search will be the only search engine in the Industrial tools workspace and Data explorer the only search engine in the Data management workspace.

  Overall, search includes these additional features to Data explorer:

  • Search data from any type of data model, including CogniteCore and CogniteProcessIndustry. In Data explorer, you can only search for data from asset-centric data models.
  • Extended 3D model options, such as scenes that are linked to locations, advanced measuring features, and objects highlighted in color according to set thresholds.
  • A Copilot that filters and finds data and helps you summarize information in one or more documents.
  • Locations to narrow down data and context.

• Sort search results in a Tree view . For asset-centric data models, you can select an asset in the tree to expand the view and see the parent/child relationship. You’ll see the tree as a card on the details page. Note that you can't use the Filter button or search with text in this view.

• When you use 3D in search, you can crop and slice objects in x, y, and z directions using in the sidebar to unveil 3D objects, such as buildings with walls and roofs.

• On Canvas

  • Monitor a system by setting up color-based thresholds for items on a canvas or an engineering diagram, for instance, for corrosion rates or operating temperatures.
  • Select Cause map from the toolbar to create diagrams, typically while performing a root-cause analysis. Add stamps, sticky notes, images, or data to the cards. Select a card to set a status, change color, or set up color-based thresholds.
  • Canvas now supports the Cognite data models, CogniteCore and CogniteProcessIndustry.

• For Charts, we're adding a new way for users to find and add time series and create and import calculations. Select Add data from the top bar, and then select to add time series or calculations.

  • Charts now supports the Cognite data models, CogniteCore and CogniteProcessIndustry.

In the Data management workspace

• Cognite provides out-of-the-box data models to help you build a structured, flexible and contextualized knowledge graph of your industrial data. The data models include containers and views and can be used at scale out-of-the-box.

  • Cognite's core data model, CogniteCore, offers standardized building blocks for industrial data, forming the basis for more specialized models.
  • Cognite's process industry data model, CogniteProcessIndustry, is the first of Cognite's industry-specific data models. It extends the core data model to meet typical process industry needs.

  To offer a perspective of the data explicitly tailored to your use cases, solutions, or applications, you can create custom data models by extending Cognite's data models or creating new models from scratch.

• Set up digital locations corresponding to physical areas, such as platforms, plants, or factories. You can set up locations or a set of parent-child locations as a filter across data models, data sets, and 3D content. You can't use locations to manage access to data.

  Users can use the locations or a specific data model to filter data in search, Canvas, and Charts.

• We've revamped the 3D tool for configuration for a better-guided user experience and streamlined the upload and configuration process. 3D contextualization is now available to integrate and visualize the 3D content in the CogniteCore data model.

• We're introducing new Cognite connectors where you can extract and write back data for the Petex PROSPER simulation tool. (Beta)

• We've added production ready extractor support, hosted by Cognite, for MQTT, and Kafka, as well as Beta availability for Azure Event Hub, REST APIs Cognite hosted extractors.

• Automate the execution of data workflows with triggers, and nest data workflows with sub-workflow tasks that reference other workflows. This is typically useful if you want to orchestrate complex workflows or reuse workflows.

• In Transformations, you can write to the type property of nodes and views containing properties of type enum, list of direct relations, and reverse direct relation.

• CDF can now retrieve data points based on a named time zone, or using specified time offsets (with 15-minute increments). The data point aggregates using the Gregorian calendar-based units of time, such as days, weeks, months, quarters, and years. The default value is your regional setting.

• Data modeling now includes two inspection endpoints for views and containers.

InField

Beta

The features described in this section are currently in beta testing and are subject to change.

• Observations on desktop. Create observations in the desktop version of InField.

  The desktop version lets you view, filter, and change observations made by you or field workers. You can also send observations to SAP and see the status of the observations you sent. You can delete observations with the status Draft or Not sent.

• Search improvements

  • Desktop. Find a checklist or a template by its name.
  • Mobile. Find a checklist by its name and search for assets within a checklist.

• Extend your work screen

  On the desktop, you can extend the right-side panel when adding tasks to templates and viewing work orders and checklists on the Overview page. You can also extend the tasks panel on the Checklists tab.

• Extended description

  In the Description field, add more information to the task. The character limit is now 3000.

• InField on Google Play

  Download the InField application from the Google Play Store to your Android devices.

• First-time users onboarding

  On the sign-in page, new users can select their application language, location, and discipline before they sign in for the first time.

• Write-back to SAP source system - Update maintenance notifications and attachments in SAP S/4HANA source systems. Will deliver a scalable multi-cloud product to General Availability (AWS, Azure & GCP) for InField.

InRobot

Beta

The features described in this section are currently in beta testing and are subject to change.

• User interface updates

  • Check the status of the robots when they're in control, running the mission, docked, stuck, etc. You can also check the battery charge and see when the robot is charging.
  • When creating a mission, collapse the right-side panel to get an extended view of the map, video stream, and logs.

• Deploy InRobot with CDF Toolkit

  Use the CDF Toolkit to set up pre-built configurations for InRobot.

• Integration with SV600

  The SV600 Fixed Acoustic Imager integrates with the robot, allowing it to detect unheard or unseen air leaks..

Cognite API updates

To see changes to the Cognite API, visit the API changelog.

Deprecated and retired features

See Deprecated and retired features.

Resolved issues and minor updates

Cognite Data Fusion

• On the search details pages, you'll now see any type of relationship, such as direct relationships and edges, grouped into cards based on data or resource type. On top of the page, you'll find tabs to investigate the respective properties.

• Selecting which columns to display is now available for all categories in search, Canvas, and Charts. Order the columns when you select columns and adjust the column width by drag in the column headers.

• Numbers are now rounded down to nearest thousand and an incorrect plus sign for rounded numbers are removed in Data explorer and search.

• Sorting is removed from the Is string and _Is step columns on the details page for time series when you search.

• All pages in search now respond faster.

• The carat of the mouse cursor now works correctly if you're searching using Japanese language.

• If you switch CDF project, CDF now opens the active page in the project you switched to.

• Right-click a workspace in the Switch workspace dialog box to open a workspace on a new tab or window.

• If you open the File details page when you search, the Linked assets section now only shows linked contextualized assets.

• Items, such as sticky notes or shapes added to data on a canvas now sticks if you move the data around on the canvas.

• In Data explorer, the Link to resources option on the File tab did not work. This is fixed.

InField

• Fixed issues with creating templates and checklists from work orders. Some operations in work orders didn't show or lacked details, and some scheduled checklists didn't create automatically.

• Fixed issue where you could see operations that belong to a work order in CDF but not in InField.

• Fixed issues with locations where you couldn't switch from one location to another, or when switching to another location, you could see the wrong data or no data at all.

• Updated the InField function to fix an issue that happened when over 1000 scheduled checklists were created at the same time.

• Fixed issues with offline mode to avoid repetitive interruptions with connectivity state.

August 2024

Deprecated and retired features

• Maintain v1 is deprecated from August 6, 2024, and will be retired from August 6, 2025.

See also: Overview of deprecated and retired features.

June 2024

sfat

These features will become available in June 2024.

New and updated features

Cognite Data Fusion

On the CDF homepage, we're introducing a sidebar for accessing your tools and new workspaces with groups of related tools. Switch between the workspaces by selecting a workspace name:

• Industrial tools - Explore, analyze, and trend data using search, Canvas, and Charts. This is the default workspace the first time users open CDF.
• Data management - Model, integrate, and transform data. We've moved some tools into the Build solutions folder and updated some tool names.
• Access - Manage access to CDF. This workspace is only available if you have access management rights.

Charts now indicate data quality. Uncertain data points appear as shaded lines and bad data points appear as a gap in the chart.

For search

• Select to sort and select columns. Currently, you can sort and select the default categories. Space may limit the number of columns displayed.
• Admins can create filter combinations, such as latest revisions or work orders, available as Saved filters, to simplify looking up data. Contact your Cognite representative to set this up.
• The 3D toolbar now includes options to measure volumes, switch between metric and imperial units, and apply color overlays to time series.

For data onboarding

• Use the Cognite API for Data workflows to re-run failed, timed-out, or terminated workflows from the point of failure. In addition, the automatic retry function in failed workflows now works better for temporary errors in the underlying service it attempts to trigger.
• Transformations now allow conversion of source system units to units defined in CDF and selecting global data models as targets.
• Time series data points now display data quality status codes. This helps you determine how to treat bad and uncertain data points and to better visualize data when you’re plotting data points in a chart. This feature follows the OPC UA standard, and the Cognite OPC UA extractor, Cognite PI extractors, and Charts support this feature.
• Time series data point aggregates now support 1-month, 3-month, and 12-month time granularities and the ability to align them to time zones specified in your query. (Beta)

For building solutions

• Use Streamlit in CDF to build custom web applications. For instance, you can create data visualization tools, dashboards, or prototypes and make these available to end-users in the Industrial tools workspace. (Beta)

For access management

• CDF now supports using Amazon Cognito as the identity provider (IdP) for managing access to CDF.

Release states

Canvas, search, Data workflows, monitoring, and scheduling calculations in Charts, and scene configuration in the 3D setup have reached production release state.

Early adopter

The features described in this section are currently only available to customers via our Early Adopter program. For more information and to sign up, visit the Early Adopter group on the Cognite Hub.

• Structure data according to a predefined core data model.
• Integrate simulator data using the Cognite API.

InField

Beta

The features described in this section are currently in beta testing and are subject to change.

• Work order tasks. Create a checklist from work order tasks.

  Before, you could create a single checklist from the work order. Now, you can create a checklist from several work order tasks relevant to a particular field worker. You can also create another checklist with the remaining tasks. The work order will remain in progress until field workers complete all tasks in the work order.

• Delete checklist. Delete a checklist from the field worker's work plan.

  You can only restore the deleted checklist through the Cognite API. If the field worker collects the data before the checklist is deleted, the data is saved and stored in InField.

• New mobile landing page.

  This page is dedicated to data exploration on mobile devices and includes an updated sidebar for easy navigation between exploration, checklists, and observations.

• Create and customize observations.
  You can create observations on all devices. If you use SAP as your work management system, you can send the completed observations to SAP.

  As an admin, you can configure observations. You can select what fields to include in the observations, how to name the fields, and what observation types and priorities there are.

• Show or hide functionality.

  When configuring InField, you can select what functionality to turn on and off for users in each location. You can also turn off all functionality to access the data explorer only.

InRobot

Beta

The features described in this section are currently in beta testing and are subject to change.

• Plan missions without robots. (private beta) You can create or edit missions without controlling the robot and using the 360-degree images it has previously taken. As you work with the images, you can move the camera to find a new position for the robot to inspect.

• Automatic position saving.
  Now, you don't need to use the Save position button to save the camera position change in a mission, as InRobot automatically saves the camera position and its values.

Deprecated and retired features

A new runtime for Cognite Functions has been rolled out. Functions created before March 22, 2024 on a Google Cloud cluster will need to be re-created to continue using Cognite Functions. The old Cognite Functions runtime in Google Cloud clusters is deprecated from April 23, 2024 and will be retired from April 23, 2025.

See also: Deprecated and retired features.

Resolved issues and minor updates

Cognite Data Fusion

Canvas

• When you add data, a select all checkbox for filters is available when you expand a resource type.

Search

• Filter buttons display the number of applied filters.
• Sort results within a category in the side panel in 3D.
• Filters used AND between the selection of several values for a key. This has been corrected to use OR.

For data modeling

• Views with no filter no longer count or list all instances in the CDF project.
• Query responses in the query explorer now include the request made to the Data Modeling Service (DMS) in a GraphQL format.

For contextualizing data

• When you selected candidate assets for searching within a diagram in Diagram parsing, only the first 1000 labels were available for filtering. Now, all labels are available for filtering.

InField

• Fixed the issue where the deleted templates in the Draft or Ready status appeared on the Deleted tab with the unchanged status.

• Fixed the issue where the values captured for the second time series could be lost when adding the same time series for two tasks in the same template. Now, both tasks show the captured values when viewing the completed checklists.

April 2024

notă

Cognite is moving to a quarterly release cadence. The next main release is scheduled for June 2024.

New and updated features

Cognite Data Fusion

In Charts:

• To assess monitoring jobs, use Alerts in selected time frame. This section displays the number of alerts that would have been triggered based on your settings. Use this info to determine appropriate alert threshold values. (Beta)

• For a detailed view of time series values at a specific moment, select Slider from the tools menu. Use this setting to compare different time points and observe trend changes.

• The maximum number of individual data points in a chart increases from 500 to 100,000.

On Canvas:

• We're introducing a new user experience for finding and adding data to a canvas. Select Add data, enter a query in the search field, then use the left sidebar to filter the search results by category and the Filters button to refine each category. This user experience aligns with how you find data in CDF.

• To collaborate with colleagues who haven't signed in to CDF, share your canvas by entering their email address under Share. They'll get an email invitation with a link to the canvas, and will need to authenticate to get access.

In Search:

Beta

The features described in this section are currently in beta testing and are subject to change.

• Sort names or counts in ascending or descending order () in the search results, in the list of categories, and on the data on the search details pages.

• The sidebar has two sections: a set of default categories that apply to all data models, and a list with other categories that adapt to each company's specific data model.

• If you search using Copilot, it identifies relevant categories and applies filters to the search results. You can modify the filters or select a different category to adjust the results.

• To visualize data on an X- and Y-axis, select the statistics icon on the Copilot results page. Note that this feature is only available for the categories listed under Other categories.

For setting up 3D content:

Set thresholds for your 3D environment to highlight important attributes or criteria and identify patterns and anomalies in your scenes. Visualize the thresholds in the 3D scene by applying a color overlay.

For access management:

We're introducing group membership within groups in Manage Access.

To give access, admins previously had to create groups in their IdP, add users to these groups, and then link the IdP groups to groups in CDF. Now, admins can directly add users to groups within CDF, streamlining the access management process. You can also use this feature when you create or edit a group.

When you've added the required capabilities to the group, select an option under members:

• Externally managed: Provide the group ID of a group with users in your IdP. This is the existing solution.
• List of users lets you add and remove users. The listed users will have access given by the capabilities in the group.
• All user accounts gives access to capabilities in the group for all user accounts in the organization. Use this option carefully, it may lead to unintended access granted to every user in the organization.

For data onboarding:

• Use the new Cognite Kafka extractor to extract data from Apache Kafka.(Beta)

• Use the Cognite File extractor to extract documents from OpenText Documentum and OpenText Documentum D2. You'll also find these improvements to the file extractor:

  • In the configuration file:
    • Use the new filter section for advanced filtering logic.
    • Use the new delete-behavior section to detect hard or soft-deleted files.
    • Use the new metadata-to-raw section to ingest file metadata to a table in CDF RAW.
  • For connections to Sharepoint Online sites:
    • Connect to multiple sites using the paths parameters.
    • Configure sites by pasting the URL directly into the configuration file.
    • Dynamically discover sites by adding several sites to the filter section.
  • The file extractor now supports ingesting files larger than 5 GiB.

InField

Beta

The features described in this section are currently in beta testing and are subject to change.

• Manage columns. Customize the Overview page.
  Add, hide, or rearrange the columns to view the information that's more relevant to you.

• Work order details. Combined the Assets and Operations tabs.
  Now, you can find information about assets and tasks to be performed under one tab. Open work order details and select the Operations tab to see field workers' tasks and the work center information. Expand the task to see if it applies to several assets.

• Overview filters. Save your favorite filters and use them as default.
  On the Overview page, use filters to get the most relevant data and save the filter selection to use next time. You can apply one of the saved filters based on your needs or set the filter as default.

InRobot

Beta

The features described in this section are currently in beta testing and are subject to change.

• Robot selection. Select a robot when needed.
  Before, you had to select a robot when you started using the application or switched from one tab to another. Now, the robot you used the last time will be selected automatically, and you can switch the robot at any time.

Resolved issues and minor updates

• Filter settings are kept while you browse the details tab in Data Explorer and Search.

• The filtering logic for And and OR operations are adjusted in the Data Explorer.

Deprecated and retired features

• Cognite Documentum extractor is deprecated from April 2, 2024, and will also be retired from April 2, 2024. Support for OpenText Documentum and OpenText Documentum D2 has been integrated into Cognite File extractor.

• Support for Python 3.8 as the default Python runtime in Cognite Functions is deprecated from March 11, 2024 and will be retired from October 1, 2024. The default Python runtime in Cognite Functions is updated to version 3.11.

See also: Overview of deprecated and retired features.

March 2024

sfat

Watch the summary in the product release spotlight.

New and updated features

Cognite Data Fusion

On the Canvas:

• Add charts to your canvas from the Add data option on the canvas or from Open in Industrial canvas on a chart. The chart on the canvas includes any threshold values and time series calculations. To edit a chart, select Open in Charts from a time series. (Beta)

• Create plans and diagrams, such as cause map diagrams, by adding sticky notes using the dots around an existing sticky on the canvas. Drag a dot to create lines between the sticky notes. (Beta)

In Search:

• If you browse a 3D model from the search page, you'll find additional options for navigation and visualization:

  • Orbit mode: Rotate around objects to see all sides.

  • Fly mode: Look around the exterior or interior of a closed room.

  • Move instantly to any spot by double-clicking anywhere in the 3D model.

  • Color overlay: Use this option on the toolbar to highlight objects on the model. Your CDF admin predefines the options on this list. (Privat beta)

For data onboarding:

• Data workflows is a new managed process orchestration service to coordinate interdependent processes, such as CDF Transformations, Cognite Functions, requests to the CDF APIs, and other data processes. (Beta)

• By aligning all 3D content, such as point clouds and CAD models, in a location, the users will get better context and understanding of the physical conditions of a location. You do this by configuring a 3D scene under Set up 3D content. You need a scene to view 3D models from the search page.

• Run CDF Transformations incrementally for transformations that read data from a CDF data model. CDF will only read and transform data that has changed since the last run. (Coming soon)

• Assign units from the CDF unit catalog to time series instances and to float32 and float64 base type for data models. For unit-aware time series and data modeling properties, you can request unit information and consume data in a compatible unit. CDF handles the unit conversion automatically.

• If you're modeling data using the CDF user interface, you can now see how relationships of data is stored in containers, what data can be queried (the views/data models), how graphs are constructed (containers), the relationships between data objects (edges and direct relations), and how these are consumed (from views and data models) by queries.

• In-product guides are available for onboarding new users to Charts and the 3D view on the search page.

For time series:

• Subscribe to one or multiple time series to automatically obtain the latest data points or changes to data points for one or more time series. This is useful if you keep a chart or a dashboard up to date with the latest time series values or need data points to perform calculations.

• Time series data points now display data quality status codes to help you determine how to treat uncertain data points and better visualize data when you're plotting data points in a chart. The implementation follows the OPC UA standard, and both the Cognite OPC UA and PI extractors support this feature. (Beta)

Jupyter Notebooks

• Open Jupyter Notebook directly from the CDF staging area (RAW) and the data model user interface. (Beta)

• Jupyter Notebook copilot is improved, and better understands CDF and the Cognite Python SDK. (Beta)

New Python data modeling SDK generator

• We're introducing Pygen, a Python data modeling SDK generator. Pygen is a Python package and a command-line interface for generating Python SDKs from CDF data models. (Beta)

InField

Beta

The features described in this section are currently in beta testing and are subject to change.

• Conditions. Set conditions to tasks.
  Add actions for the field workers to perform depending on the task state. In the first implementation, you can show a message with instructions, questions, etc. when adding a template task.

• Device mode. Set a default mode for InField.
  Switch to a mobile or a desktop version of the application on your device and make it the default. The setting doesn't affect the mode of other devices.

• Overview filters. Search and filter the Overview page.
  Search for checklists and work orders by name and filter on the checklist status.

• Checklist date. View the checklist creation date.
  In the list of checklists, check the date when each checklist was created, along with the day of the week and time.

• Schedule. Add monthly and yearly intervals.
  Create daily, weekly, monthly, and yearly schedules for checklists to perform at regular intervals.

• Templates. Hide the templates list.
  Hide the panel with the list of all created templates while creating a template, adding tasks, and viewing asset information.

• Offline mode. Improved data storage.
  If the users have a slow internet connection for more than 5 seconds, the application switches to offline mode. Users can upload the data when the connection is back.

• Observations. Updated observations type and priority.
  Select a priority option from 1: Immediate to 5: Greater than 8 weeks and one of 5 observation types (M1, M2, M4, M5, M8).

InRobot

Beta

The features described in this section are currently in beta testing and are subject to change.

• Video. Record videos of up to 60 seconds of assets in motion. For example, record a video of a water pump to see the water flow.

• Waypoints. See the direction of the robot’s movements on the 3D map with the help of cone-shaped waypoints.

• Move map to model. Move the waypoints to the 3D model. Adjust the position of waypoints if needed.

• Media preview. In Reports, see which runs include images and videos.

• Filter missions. In Reports, search a mission by name to find the mission of your interest faster.

Resolved issues and minor updates

Cognite Data Fusion

In Charts:

• If you manually set the range of an axis, an indicator and a button appears where you can reset to automatic range mode.

• Function descriptions are now available in all the languages CDF support.

On the Canvas:

• You can now paste local files directly onto the Canvas using Ctrl + V (Windows) or Cmd + V (macOS).

In search:

• If you're using CDF in Japanese, the kana-kanji conversion now works correctly.

• The related asset count on the asset details page now shows all related assets. Previously, this count had a limit at 1000.

• Search for events using metadata ID is improved.

InField

In InField, we've resolved these issues:

• You won’t see information about a previously selected asset when switching from one checklist to another.

• After the mobile users enter a numerical value, the application won’t jump to the next numerical reading and skip the tasks in between.

• When adding a description to an observation, the users will stay on the same step unless they select the next or previous step.

Deprecated and retired features

See Overview of deprecated and retired features.

Cognite API updates

To see changes to the Cognite API, visit the API changelog.

January 2024

sfat

Watch the summary in the product release spotlight.

New and updated features

Cognite Data Fusion

• We're introducing in-product tours to help new users get started using CDF. The tours start automatically the first time you open the CDF homepage, the Search page, the Canvas, and InField.

• You can now access Data Explorer, Canvas, and Charts directly from the updated CDF homepage. Select Data management to see data engineering and administrative features.

• On the Canvas:

  • See and restore previous versions of your canvases from Open canvas history. Canvas checks for updates and stores a new version every 5 minutes. You can't edit previous canvas versions.

  • You'll receive an email with a link to the canvas if a colleague mentions you in a comment.

  • The toolbar has new shapes for industrial data.

  • Lock a canvas to prevent unwanted changes with the Lock canvas option under the ... icon.

  • Select the copilot () icon within a document to use AI to find or summarize information in the documents. (Beta).

• If you subscribe to monitoring alerts in Charts, the email notifications now include an investigation button that brings you directly to the chart and an option to unsubscribe to the emails. We've also made these improvements:

  • Edit existing monitoring jobs with the new Edit button.

  • Select among multiple new colors for time series diagram lines.

  • Highlight the threshold line on a time series by selecting a monitoring job.

• On the Search page (Beta), we've made these improvements:

  • The search results show directly linked data from the asset hierarchy data model and the CDF data model framework.

    • If you're using the asset hierarchy data model, contextualized data is based on relationships, annotations, and direct links.

    • If you're using the flexible data model framework, contextualized data is based on annotations to asset hierarchy resources, edges, direct relations, and strings references.

  • To continue analyzing and collaborating on the data, select Open in Industrial canvas from Data Explorer and Search.

  • If you open an engineering diagram in Search, orange-colored boxes indicate links to other files. Purple-colored boxes indicate links to other data objects, such as additional information about equipment.

  • Select the Copilot () icon within a document to find or summarize information in the documents. (Beta).

• In the 3D view on the Search page, we've made these improvements:

  • From the side panel, you can filter all 3D objects within a 3D model and the data directly linked to the 3D object, such as work orders and sensor data. The 3D objects are highlighted in the model and have a preview card with directly linked items.

  • On the preview card, you can open directly linked files, such as engineering diagrams, and see a file preview on top of the 3D object.

• In CDF data modeling, the expressiveness of the industrial knowledge graph is extended with the new relation type reverse direct relation. Defining types that have properties that are nodes pointing to the current type improves consistency and query ergonomics.

• The Cognite SAP extractor now supports multiple SAP sources, SAP RFC and SOAP endpoints, multiple CDF resource type destinations, and multiple keys when ingesting to CDF RAW. Note also that the configuration schema is updated to support multiple SAP sources.

• Under Match resources to asset, you'll find these changes in the user interface:

  • On the Select source page in Quick match, the filtering options for data sets now only display the data sets containing the selected resource type.

  • On the Review results page in Quick match, you'll now see the current asset to which the resource is linked to alongside the suggested asset.

  • The 3D matching option is moved to the Select Source page, and you'll find 3D node among the resource types for selection.

• When you upload 3D models to CDF, you can use AI to enhance point clouds with classifications and object detection. Navigate to Integrate > Upload 3D, then select the icon .

• We're introducing request and concurrency limits for the CDF RAW service.

• Assign units to time series and numerical properties in data models. The industrial knowledge graph stores numerical data with associated units selected from the built-in unit catalog. Then, perform unit conversion on query time for time series data points, which saves you from having to handle conversion.

• In the Cognite JavaScript SDK, you can retrieve data points with granularity set as a month.

• The Industrial Data Science library is now open-source and open to external contributions. See https://github.com/cognitedata/indsl.

InField

Limited availability

The features described in this section are currently only available to selected customers.

• Item to check. Add extra items to be checked to the task.
  Describe what needs to be done and add alternative responses (action buttons). Each response can be linked to a task status. When working on the checklist, select the response with the linked status. The task status will automatically change to the status linked to the response.

• Bulk status change. Change the status of the remaining tasks in the checklist.
  When working on a checklist, bulk change the statuses of the remaining tasks. You can do that for the tasks inside and outside the group and only once.

• Task description. Provide a description or step-by-step instructions to explain what field workers need to do when working on a checklist.

• Observations. Provide asset observations.
  Field workers can create observations when working on a checklist or selecting the menu button > Create observation.

• Schedule. Formerly Task intervals.
  Specify the start date for the checklist to open automatically and set your tasks to repeat on daily or weekly intervals.

• Message. Enter a message or a question that requires a reply.
  Ask operators to write a response to your request, question, message, etc., when working on a checklist.

Resolved issues and minor updates

Cognite Data Fusion

• In the Data Explorer, we've resolved these issues:

  • Resource types displayed a maximum of 100 linked items. Now, there are no maximum limits.

  • The results were not updated if you entered a value in the Internal IDs field under the Common filters sidebar.

  • If you initiated contextualization for files with assets and reran the contextualization without assets, the files would still be contextualized.

  • For some users, CDF would end if the asset hierarchy data model exceeded ~6.5k nested nodes.

• In Charts, we've resolved these issues:

  • You could not create a monitoring job if you entered a float value in the Minimum duration field.

  • Unit texts are now adjusted to fit the table view.

• In InField, we've resolved these issues:

  • You can now work on a checklist in offline mode on a tablet in landscape view.

  • Checklists didn't appear as scheduled.

  • Tasks disappeared when you tried to duplicate them.

  • Check item action buttons didn't appear in checklists.

• In 3D models, end preparations on circular tubes didn't appear correctly.

Deprecated and retired features

• Cognite Discover, along with the Well Data Layer (WDL), is deprecated from November 10, 2023, and will be retired from December 31, 2023. Document Search has been integrated into Data Explorer.

See also: Overview of deprecated and retired features.

Cognite API updates

To see changes to the Cognite API, visit the API changelog.

October 2023

New and updated features

Cognite Data Fusion

• Use the new search on the CDF home page to find data for your daily tasks. The search results show all connected (contextualized) items to give the full context of your data. You can open the results directly on the Industrial canvas or Charts for further analysis and collaboration. (Beta)

  You can also find data using Cognite AI (artificial intelligence) for industrial data. Select the Search using AI tab to try one of the example questions or write your own. (Beta)

• We've added several features to the Industrial canvas. Copy content between canvases, duplicate canvases, and select which properties to show on asset cards. (Beta)

• In Charts, create a calculation pipeline by saving, scheduling, and monitoring calculations. (Beta)

• In the Data explorer:

  • Filter assets, time series, files, events, and sequences by all linked resources, directly linked resources, and relationships. For assets and files, you can also filter by annotations.

  • Filter by Parent and Child under Assets in the sidebar.

• Jupyter Notebook with AI copilot is now an integrated part of CDF. Use Cognite AI to write and understand code or explain scripts from others. Notebooks run in a sandboxed environment inside the browser using the current user credentials. You can share notebooks with your coworkers. (Beta)

• To search for equipment using 3D models, admin users can manually link objects or areas in CAD models and point cloud models to equipment and update existing links between 3D objects and tags. (Beta)

• The new Cognite OPC Classic extractor reads time series and asset information via the OPC DA and HDA protocols. (Beta)

• User profiles are now generally available. When activated by a CDF admin, user profiles let users share data and mention their coworkers.

• For Model your data, we've made these improvements:

  • When you open the code editor without being in edit mode, you'll find links to Preview data and Transform data above each data type.

  • In the Types section:

    • The Add type button is now located in the header panel.

    • Search for data types in the Search field.

    • Select Type or Interface when you add a type.

    • Each type is labeled with additional info, such as import and read-only directives.

  • In the GraphQL section, you can use the @default directive to set the default value for a property. For instance: type Pump { weight: Int @default(value: "5") }

InField

Limited availability

The updates and features are currently available to selected customers only.

• Offline mode. Complete operator rounds and work orders without network connectivity.

  Open the checklist on your mobile device before performing tasks, and if you go offline, you can still complete your tasks but with limitations. When offline, you can't access the asset explorer, upload media, or create observations.

InRobot

Early adopter

The updates and features are currently available to selected customers via the Early Adopter program.

• Mission scheduling. Automate robot missions.

  Plan single or recurring autonomous robot missions, set the date and time of the mission, or skip one of the scheduled mission runs.

• Gauge details. View the gauge type and gauge values in the reports.

• Gauge asset metadata. Edit the gauge asset metadata in reports to improve gauge reading functionality.

• Time series access. Navigate from Reports to Data Explorer to analyze time series.

Resolved issues and minor updates

Cognite Data Fusion

• In the Data explorer, we've resolved these issues:

  • On the Asset tab:

    • If you select an asset, you automatically navigate to the same asset when you open the Hierarchy tab.

    • The asset hierarchy only displayed if the root asset was displayed on the first page of the results.

  • On the Files tab:

    • Some files were incorrectly linked to an asset.

    • If you added multiple tags to an engineering diagram, the Select button would show as deactivated.

  • On the Details tab:

    • The Label field now displays the same name as in the source system.

• On the Industrial canvas, we've resolved these issues:

  • When you add data to a canvas, the Load more button and the date selector for time series are easier to access.

  • If you added a rectangle around an engineering diagram, you couldn't interact with the annotations.

  • Lines didn't display correctly on the engineering diagrams.

• In Charts, we've resolved these issues:

  • The chart now previews a threshold line when you configure a monitoring task.

  • If you monitor time series, the email alerts contain more context for threshold breaches.

• In the Create interactive diagrams, we've resolved these issues:

  • When you selected a set of assets to link to a diagram, some assets were excluded as potential candidates. All selected assets are now considered for linking with the diagram.

  • When you linked to other engineering diagrams, More filters didn’t display all the values correctly.

• On the CDF home page, we've resolved these issues:

  • If you've worked with Charts and Industrial canvas, these are now added to the Recent activity section.

• For Access management, we've resolved these issues:

  • Some users got an incorrect Access required message when they signed in to CDF.

  • Access was denied if you closed CDF without signing out and then re-opened CDF with a URL address that included the CDF project.

• For Model your data, we've resolved these issues:

  • If you created a data model using the CDF CLI, it wasn't possible to add a description.

  • On the Data management tab:

    • The knowledge graph icon didn't open GraphQL.

    • The instance count didn't show the correct numbers.

  • The scroll bar for selecting a relationship when you create a transformation didn't scroll.

  • The field name would disappear when you added a type.

  • Reference nodes didn't load correctly.

  • If you deleted a type from the code editor and switched to the list view, CDF stopped responding.

Changes to Cognite Functions on Google Cloud Platform

From February 1, 2024, the function call timeout will be changed from 15 to 9 minutes for projects running on Google Cloud Platform (GCP). Learn more.

Deprecated and retired features

Cognite Data Fusion

• Automatic Identification and Reporting (AIR) is deprecated from October 6, 2023, and will be retired from December 31, 2023. The core functionality of AIR has been integrated into Charts.

• Asset Data Insight (ADI) is deprecated from October 5, 2023, and will be retired from December 31, 2023. Charts, Industrial canvas, and Data explorer are available through fusion.cognite.com to replace the key ADI workflows.

See also: Overview of deprecated and retired features.

Cognite API updates

To see changes to the Cognite API, visit the API changelog.

August 2023

Enhancements

• Work in your preferred language in InField, Maintain, Charts, Industrial Canvas, and the Data Explorer. Navigate to Manage account on your user profile and select among the languages listed below. This feature is in Beta.

  Deutsch - English - Español - Français - Italiano - Nederlands - Norsk - Português - Svenska - 한국어 - 中文 - 日本語

• Collaborate on the data on a canvas, for example by entering comments and tagging co-workers. Select Share to give co-workers access to the canvas. This feature is in Beta.

• You can now use data from your custom CDF data models in Power BI, and use GraphQL mutations to update your data model data.

• Use data point subscriptions to configure a subscription to listen to changes in one or more time series. A time series may be part of many subscriptions. Use this feature if you need to keep up to date with changes to one or more time series without re-ingesting the entire time series. See also the API documentation or try it out using the Python SDK. This feature is in Beta.

• We're releasing the Cognite File Extractor into general availability and upgrading the Cognite DB Extractor to version 3 with the following enhancements:

  • Ingest data into the CDF asset and event services by structuring the query to return keywords as column names. You can also write a table to CDF sequences, and if the database contains binary data, you can upload it to CDF files.

  • Native support for databases, such as PostgreSQL, Snowflake, Azure Cosmos DB, and MongoDB, means you can connect to the extractor without using Open Database Connectivity (ODBC) drivers.

  • Schedule queries with cron expressions or intervals, for example, 6h or 15m. Disable scheduling with a global configuration parameter while leaving the schedule keyword in the query configuration, for instance, for debugging or manual runs.

• Ingest data into CDF using the MQTT streaming service~. Cognite's infrastructure hosts the extractor, and you configure the extractor using CDF to connect to an MQTT broker. You listen to data by subscribing to topic filters and specify the message format for the extractor to ingest data arriving on the configured MQTT topics. This feature is in Beta.

• In the Cognite Python SDK, you can now use advanced search and filtering on metadata across events, time series, asset, and sequences, using the .filter() method, for example, client.events.filter.

• In Cognite InRobot, you can:

  • Pause/resume missions as you navigate the robot or when it performs missions autonomously.

  • Cancel missions, but pause the mission before you cancel it.

  • Review old and new images of inspection points on the Actions report.

  • The robot can return to the dock without the docking station in sight.

  This feature is in Beta.

Limited availability

notă

The features described in this section are currently only available to selected customers.

• We're releasing new experiences for Cognite Maintain and [Cognite InField]. This includes a new user interface and functionality for both applications to streamline the Cognite asset performance management offering.

• Create a calculation pipeline in Charts by scheduling and monitoring calculations. Use the option Save and schedule to set the run intervals. Set up monitoring of time series and calculations together. If a threshold is breached, subscribers will receive an email notification. Beta.

Deprecated features

• Starting September 1, 2023, we'll no longer develop new features for Cognite Remote. See Deprecated and retired features for more information.

Resolved issues

• For data transformations, we've resolved issue where long-running transformations timed out due to driver restart errors.

• For the Cognite extractors, we've resolved an issue where some users experienced timeouts when running the Cognite DB Extractor. Note that the recommended size of the upload queue is 50 000 rows and that the query parameter should contain a where clause using the substitutions {incremental-field} and {start-at} if data is loaded incrementally.

• In the CDF data modeling framework, we've resolved these issues:

  • Some users got inconsistent results when listing data models using the CDF UI and the CDF API.

  • It wasn't possible to populate two or more views pointing to the same node using transformations.

  • CDF CLI, v2.3.0: The data model name and description were deleted when you published the data model.

• In the Data Explorer, we've resolved these issues:

  • If you searched for a file from the CDF home page, you were directed to the file search in the Data Explorer. Now, the file opens directly.

  • Changes weren't kept when you created tags manually on an engineering diagram and selected an asset before you saved.

  • It wasn't possible to filter by relationship on the Files tab using the tree view.

  • Some customers were not able to search in the Data Explorer.

  • The filtering of resource labels didn't limit the labels according to the filtering.

  • The file number count for a document category and linked files weren't aligned.

  • The linked asset count on the File tab in the Data Explorer and the count from the Cognite SDKs weren't aligned.

June 2023

Enhancements

• When you open the CDF portal application, you'll find a new home page with direct access to popular features. Select a card to open a feature or select View all to see all features.

• Enhancements to the CDF data modeling framework include:

  • Use the Browse library feature to select predefined data models you can tailor to your industry standards.
  • Display time series data from CDF data models in the Grafana connector.

• Enable user profiles to let users share data and @mention other users.

• Extract data from SAP with the new Cognite SAP extractor.

• Fine-tune the results in the Data explorer with dynamic filtering for units and metadata values.

• Specify a data set when you upload files or functions to CDF and filter on data sets on the Files tab in the Data explorer.

Enhancements to features in Beta testing

Beta

The features described in this section are currently in beta testing and are subject to change.

• We've released a beta version of the Cognite Industrial canvas where you can access all data, such as documents, engineering diagrams, sensor data, images, and 3D models, on a canvas.

Product release spotlight

Visit the Cognite Hub to watch the product release spotlight video.

Resolved issues

• In the CDF data modeling framework, we've resolved these issues:

  • The Data management page treated fields that started with = as an expression.
  • Some users received a 5xx error code when they created or updated data models.
  • Some users received a 4xx error code when they loaded the Data management page or retrieved data from the GraphQL explorer.

• For 3D models, we've resolved these issues:

  • We've improved the performance when you browse, navigate, and retrieve information in 3D models.
  • We've fixed an issue where contextualized assets weren't highlighted if you opened a 3D model from the Data explorer.

• For data transformations, we've resolved these issues:

  • When you selected Profile to view staged data, you couldn't sort functions in columns.
  • CDF defined the split_part Spark function as an undefined function.

• In the Data explorer, we've resolved these issues:

  • If you applied a filter to your data, the remaining filters didn't update.
  • Some files were available in data sets but not in the Data explorer.

• We've fixed an issue where some users received a 4xx error code when they created a group in CDF Access management.

• We've fixed an issue where some users experienced that files were deleted from their CDF project. We've improved the logs to track the delete history.

• We've fixed an issue where a Failure Exception: CogniteDuplicate error occurred when creating or updating time series.

April 2023

Enhancements

• We're releasing the advanced CDF data modeling framework into general availability.
  

  Data models are the core of understanding relationships between data objects and establishing data products for data science models, mobile apps, and web apps. You can now express data according to your best practice or industry requirements, such as source system models, solution-specific models, or domain data models.

  Version the models to test, iterate, and reuse them to scale with the underlying data. You can model data using the CDF portal application or the CDF CLI and review and explore the data with the built-in query explorer. .

• We now group 360-degree images from similar locations in 3D views and dim all image indicators behind geometry in point clouds or CAD models.

• Use the search parameter option next to the search bar to fine-tune your search in the Data explorer.

• Open selected time series directly in Charts with the Charts preview button in the Data explorer.

• When you create interactive engineering diagrams, we now recognize bundled tag names, for instance, Tag A/B, as separate tags.

• You can now use a key/certificate pair to authenticate the CDF extractors to Azure AD.

• 3D models visualize textured surfaces, and the Cognite Reveal 3D SDK now supports textured 3D models.

Enhancements to features in Beta testing

Beta

The features described in this section are currently in Beta testing and are subject to change. don't use the features in production systems.

• In Charts, you can define upper or lower threshold values for time series and receive an email if the thresholds are breached.
• The Cognite InRobot beta version has been updated.

Resolved issues

• In Data transformations we've resolved these issues:

  • The transformations preview didn't display data points with negative timestamps.
  • Transformations failed due to many WHEN statements in the SQL query.
  • Scheduled transformations failing due to service downtimes.

• In Data search we've resolved these issues:

  • A bug in the asset hierarchy request to CDF caused an incorrect asset sub-tree hierarchy.
  • Some file types were incorrectly sorted as Other on the Files tab.
  • If you uploaded a .zip file to Cognite Functions, the file name extension changed to .txt when you downloaded the file from the Data explorer.
  • Deleted files appeared to be available for download from the Files API and the Data explorer.

• Some users received a 5xx server error response code when they updated large amounts of assets using the CDF Assets API or the Cognite Python SDK.

• Time series matched with assets displayed as unmatched in the result preview in Entity matching.

• A blank canvas appeared when you searched on the Data tab in the Data catalog and if you created a new extraction pipeline without the extractionpipelines:read access capability.

• .svg files did not display in Charts.

• Improved wording in the error message that appears if you sign into a CDF without a project name using the Cognite Java SDK.

• When you created a CDF project, the access capability project:list wasn't included in the initial setup of a CDF project and prevented access to the Access management page.

• The processing status on the Revision details section for 3D models incorrectly reported no logs even when logs existed.

See also the Cognite SDKs and CDF API changelogs.

February 2023

Enhancements

• Transform data with a new interface in CDF Transformations.
  • You'll find a new no-code mapping option for source-to-target fields. Map the fields manually or use CDF's suggestions.
  • The Spark SQL editor offers built-in code completion, built-in Spark SQL functions, and built-in Cognite custom SQL functions.
• Discover gaps and deviations in time series with the new Data profiling side panel in Charts.
• View 360-degree images, either in isolation or in the context of point cloud, CAD, and BIM models in the Data explorer.
• Preview documents such as text files, JSON files, spreadsheets, documents, and slides in the Data explorer.
• Ingest data from files in JSON format to the CDF staging area (RAW).
• The Annotations API is now used as the storage mechanism for annotations in file viewers. Existing annotations have been migrated from the Events API.
• We've released Cognite InField versions 11.0 and 11.1 with improvements to the InField 3D model and checklists.

Enhancements to features in Beta testing

Beta

The features described in this section are currently in Beta testing and are subject to change. We recommend that you don't use the features in production systems.

• Enhancements to the new data modeling feature include:
  • Transform data into and between data models using the new CDF Transformation user interface.
  • Improved architecture for reusing data across data models.
  • Advanced data modeling with inheritance and composition.
  • Versioning of data models and data model types to enable no re-ingestion of data across versions for common properties.
• Enhancements to the Data explorer include:
  • Filter data using multiple values.
  • View connected engineering diagrams side-by-side by selecting links in a diagram.
• Extract well data from the Open Group OSDU Data Platform with the new Cognite OSDU extractor. You can extract data using the OSDU generic API and the Wellbore DDMS. The extractor is compatible with Microsoft Energy Data Services.
• Extract documents with the Cognite File Extractor. You can extract files from local file systems, network sharing protocols such as FTP, FTPs, and SFTP, SharePoint Online Document libraries, Google Cloud Storage, and Azure Blob Storage.
• We've released a Beta version of Cognite InRobot. This new application works in sync with a robot to collect and automate data collection and inspection.

sfat

You'll find Early adapter programs and discussion groups for these features on the Cognite Hub.

Resolved issues

• Cognite PI extractor error on Windows Server 2012 R2. Note that this extractor requires .Net Framework 4.8 or higher.
• The Data set list in the Quick match option in Match entities didn't list all data sets.
• Charts would not load and displayed the error message Failed to load firebase error. Make sure to open Charts from within CDF.
• Fixed an error where scheduled transformations were deleted due to an error in the token session refresh.
• Resolved issues in the Data explorer include:
  • The filter on the File tab was case-sensitive. Now, you can enter filter criteria with all cases.
  • If you selected an asset in the list view on the Asset tab, then changed to the asset hierarchy view, the selected asset lost focus.
• Resolved issues in 3D models and Reveal include:
  • Large models with metadata weren't completely processed.
  • SolidWorks 3D models inside zip files failed to display.
• A Python SDK Protobuf version mismatch caused an error. The SDK has been refactored to support Protobuf versions lower or equal to version 3.16.0 to fix dependency conflicts with Python packages, such as TensorFlow, Streamlit, and Azure Functions.
• Fixed an error where the Cognite Functions user interface didn't show data in the Input data field when you listed scheduled functions.

December 2022

Enhancements

• Cognite Charts is now an integrated part of the CDF portal under Explore and Build. New functionality includes:

  • View CDF events and time series simultaneously on the chart plot.
  • Set thresholds to check if time series cross a specified value.
  • See calculation status messages in the user interface.
  • Get better results if you're searching for documents with Japanese content.
  • Time series descriptions automatically update if you change the description in the Description parameter for the time series in the CDF API.

• Use the new search and view options in the Data explorer to:

  • Search across all data types and add filters for metadata.
  • Search for content inside documents.
  • Customize and sort columns for the displayed results.
  • Inspect equipment surroundings and find nearby equipment by looking up the location of assets in contextualized 3D models. Use the 3D availability column on the asset panel in the asset search results view, or navigate to relevant 3D models from the asset details panel.
  • Add multiple 3D models to the same 3D view to combine and compare models. You can add CAD models and point clouds/laser scans.
  • Measure distances and slice 3D models to focus on specific parts using the new menu options in the 3D view.

• We're introducing a Data Catalog, a collection of data sets that serves as a central and secure library of data assets you can search, explore, and manage in CDF. Use the Data Catalog to get an overview of the data that's available to you. You can also use it:

  • As part of your onboarding workflows: to get overviews of existing data and to verify that newly onboarded data appears as expected.
  • As an entry point to searching and exploring data sets and data resources.
  • As a way to manage data governance and user access to data resources.

• On the Extract data, you'll find source system logos and the best-fitted data extraction tool for ingesting data into CDF. On this page, you'll also find new Cognite extractors you can use to extract well data from source systems. In the data extraction documentation section, you'll find articles on how to set up and run the general CDF extractors and the specific CDF extractors for well data.

• Integrate and view 360 degree images in Cognite Reveal.

• The 3D service can now process Navisworks (NWD) model files. See Supported 3D file formats.

• We've added paginating to the Retrieve data points endpoint. You'll receive a nextCursor for time series with multiple data points. The first data point on the second page follows immediately after the last data point on the first page. We've also improved performance for retrieving data points for time series using the Cognite Python SDK v5.

October 2022

Images contain essential information required for optimizing operations. This release of Cognite Data Fusion (CDF) introduces image and video management, where you can upload, organize, and explore the image and video data and add annotations to the images. With the new image contextualization API, you can detect assets tags, text and people using industry-relevant detection models.

We've also made it easier to work with the data flow from a source system into CDF with the option to create, edit, and troubleshoot the extractors' configuration files in the CDF user interface.

Read more about this and other improvements below.

Image and video management

Images contain information such as the time or location of a photo, a number on a tag, or rust on a pipe. Use the new Image and video management tool to upload and enrich images and videos to CDF. Then, organize and explore your images and videos in a list view, gallery view, or on a map and add or review annotations to the images. Read more

Using the Vision API and the Python and JavaScript SDKs, you can find data based on visual content and link images to assets by analyzing the images with detection models, such as asset tag detection, text detection, and person detection. The person detection model protects privacy and complies with GDPR.

Create and edit extractor configuration files in the CDF user interface

The Cognite extractors connect to source systems and push data to CDF. When you set up or want to change the extractors, you can now create and edit the configuration files to fit your requirements on the Extraction pipeline page. This will reduce the time and effort spent accessing the configuration file on the extractor's host machine and make it easier to iterate and deploy the configurations settings and investigate extractor run issues.

When you're ready to apply the configuration to a production environment, we recommend setting up remote configuration files stored in the cloud using versioned files and continuous integration systems, such as GitHub Actions, or directly with the CDF API. Read more.

Point cloud visualization in 3D models

With improved point cloud visualization in the 3D digital twin models, you'll find the rendering of objects clearer, more uniformed and with higher fidelity. This will make it easier to distinguish which object is in front and which is in the back when looking at digital twins.

Place measurements in 3D models

Use the Cognite Reveal SDK to measure simple point to point distances in 3D models by selecting to- and from-points. For example to fit a new piece of equipment in a designated location. The default measurement unit is meters, but the tool provides callbacks to allow configuring the unit.

Historic time series

The CDF time series service now allows data points starting on 01.01.1900T00:00:00Z (1 January 1900), specified as milliseconds since the epoch. This means you can import a more complete time series history to CDF. Time should be specified as a negative integer value for data points prior to midnight on Jan 01, 1970, and as positive integer values for data points after.

August 2022

Cognite Data Fusion (CDF) makes data do more. This release focuses on rapid, reusable, and scalable industrial data science by introducing new code and non-code solutions. With Cognite Functions, you can deploy and host Python code for additional calculations and models using the data in CDF. Cognite Charts offers a guided user interface to perform industrial data analytics, troubleshooting, and root cause analysis.

Read more about this, how we've polished up the CDF user interface, and other improvements below.

Cognite Charts

Cognite Charts is a graphical user interface that lets domain experts explore data and trends and perform troubleshooting and root cause analysis. No programming skills are required to use Cognite Charts. Read more.

Cognite Functions

Cognite Functions offers Python functions as a service, reducing the effort and expertise needed to deploy solutions using CDF data. Model data in your programming language and according to your company or industry standards, then call the code on demand or schedule regular runs. Read more.

You can deploy Cognite Functions using the Cognite API, the Cognite Python SDK, and the CDF user interface.

Improved Transform data page

CDF Transformations has a new user interface to guide you through the process of transforming data from the CDF staging area to the CDF data model. The new interface is fully backward compatible with existing transformations. Read more.

Improved Extract data page

The improved Extract data page makes it easy to find your best fit extractor and the installation files. You'll also find links to the Cognite Python and .NET utils packages and SDKs to get started creating a custom extractor. Read more.

Improved Explore data page

• Files are grouped by their document type on the Files tab.
• The search bar is moved to the top of the page and displays the search results count on resource types.
• You can reset your filters, and a red badge indicates that filters are applied. You can also collapse the More filters section.
• We've improved the navigation when you search for a tag in an engineering diagram, such as a P&ID.

New Annotations API

CDF can detect references to tags and assets in engineering diagrams, documents, and images. The detections are often called annotations. The new Annotations API introduces strict schema validation to avoid invalid annotations and a well-defined flow for suggesting, accepting, and rejecting annotations. The API also enables third-party applications to enrich documents in CDF with custom annotations. Read more.

Ensure geospatial data integrity using data sets

The geospatial endpoint is the entry point for resource types enabling storing and querying item collections with a geospatial nature. You can now use data sets to document and track data lineage for the geospatial features and feature types. Read more.

3D models

You can now upload 3D models in IFC open file format to enable CDF to process and host Building Information Models (BIM).

June, 2022

This June release has several improvements for the end-user and the developer.

View more details in complex CAD models

To see more details and better understand the facility, we've improved the visual quality when you view large and complex 3D models.

Also, we have improved the 3D processing pipeline and the load performance so that you can load geometry while the camera is moving. Note! To take full advantage of the improvements, you need to re-upload any 3D models processed before March 2022.

A better user experience signing in to CDF

Signing in to the CDF user interface can be cumbersome if you don't know the authentication setup in your organization. With the new CDF sign-in flow, you only need to enter your organization's domain name and specify which CDF project you are signing in to. Your organization domain name is usually your company name spelled without spaces or an abbreviation of the name.

Add your customer logo to the sign-in dialogs for a more personalized experience.

Authenticate your CDF solutions

To allow the developer to focus on solution development instead of setting up authentication infrastructure, it's now possible to authenticate for solutions built on top of CDF without writing multiple lines of code. The @cognite/auth-wrapper is an OpenID Connect/OAuth 2.0 wrapper library written in JavaScript. It helps you retrieve an access token from any IdP that meets the OpenID standard, making it easy to sign in with our JavaScript SDK. Features in the authentication wrapper SDK include:

• NPM supported auth package
• Support for multiple auth flows
• Detailed documentation on how to use the package
• Detailed documentation on how to navigate key IdPs (i.e., Azure AD)

Search, filter, and sort data in the CDF Data explorer

We've polished up the CDF Data explorer to make it easier to find the data you are looking for:

• You can reuse any Search and Filters you have defined. Simply copy the URL and share it with your co-workers.
• The search criteria you enter in the Search bar are now kept when you toggle between the different tabs in the explorer.
• On the Files > File details tab, you can scroll up and down the list of metadata to find what you're looking for.
• We've added a notification to let you know that you cannot upload files greater than 5GB.
• You can now sort in the metadata tables.
• We've fixed reported bugs and general styling issues.

Increased number of columns for sequences​

Sequences now support up to 400 numeric columns (up from 200) and 200 string columns. Read more.

DirectQuery support for Power BI (Early adopter)​

DirectQuery is a feature in Power BI that enables you to fetch data on demand and build Power BI dashboards with hundreds of time series and thousands of data points. With DirectQuery, no data is imported or copied into Power BI Desktop. Instead, Power BI queries CDF for the data every time you interact with the dashboard.

Cognite Data Source for Grafana

The Cognite Data Source for Grafana now supports the CDF relationships resource type. You can fetch time series based on relationships in the Time series from asset tab and filter the relationships on data set, labels, and active relationships based on the time filter selected in Grafana. The new Relationships tab allows you to use Grafana's Node Graph visualization plugin or the new (alpha) custom visualization plugin available at cognite-grafana-relationships-visualization.

Templates support (Early adopter)

We've added a new Templates tab to support the CDF Templates feature. Using templates with Grafana allows you to scale your dashboards dynamically when you add equipment. You can enable this feature in the data source settings.

Read more about Templates and Early adopter.

April, 2022

Data governance is key to ensuring high quality throughout your data's lifecycle, and Cognite Data Fusion (CDF) has the tools and features to secure that the data meet your expectations. This release optimizes data management by introducing more granular access to data transformations using data sets.

Read more about this and the other improvements for the CDF April 2022 release below.

Scope transformation access to data sets

Protect access to CDF SQL transformations from ungoverned actions and visibility by associating a transformation to a data set. Users will only be able to see and run the transformations associated with the data sets they have access to.

• As a project admin granting users access to transformations, select the data sets a user can see and run transformations for under Scope in the Transformations capability dialog:

  

• As a user creating a transformation, select the data set you want to associate to a transformation in the Create new transformation dialog. Only users with transformation access to this data set can see and run the transformation.

  

This feature is also available in the CDF API, Python SDK, and Transformations CLI. Read more about transformations.

Ingest data into sequence rows

You’ll now find Sequence Rows as an option in the Destination type field on the Transformations page in the CDF user interface and no longer need to use other developer tools like APIs and SDKs to ingest sequence rows into the Sequence resource type in CDF.

Develop applications using Java

Already, you can build solutions using Cognite's SDKs. Now, we introduce the Cognite Java SDK to interact with the CDF v1 APIs. The Java SDK is optimized for data publishing and allows you to write data efficiently with the upsert function. The Java SDK covers core CDF functionality, such as contextualization and data extraction. You’ll find all the info you need in the cdf-sdk-java repo, and we have updated the Cognite API documentation with code samples on how to perform tasks with the Java SDK.

Change isStep setting for ingesting time series to CDF

When you stream time series data points into the CDF data model, the interpolation between the data points is controlled by the isStep property on the time series object. You can now change the isStep property value without recreating and re-ingesting the entire time series.

February, 2022

Cognite Data Fusion (CDF) streams data into the CDF data model, where the data is normalized and enriched by adding connections between data resources of different types to provide better business decisions. With this release, you can ingest geospatial data into CDF to contextualize and map with other CDF resource types to deliver accurate spatial analysis and statistics.

Read more on this and all the other improvements for the CDF February 2022 release below.

Geospatial data

Work with geospatial data using the Geospatial API and Python & JavaScript SDKs to handle the positioning and geometry of CDF data. We currently support a multitude of coordinate reference systems (CRS), but you can add other entries from the European Petroleum Survey Group (EPSG) as a custom CRS. You can also transform an input CRS to the defined CRS to improve the search in geometrics. Read more.

Ingest PI Asset Framework data to CDF

The new Cognite PI Asset Framework (AF) extractor is considered an extension to the Cognite PI extractor. The Cognite PI AF extractor retrieves a dump of the asset hierarchy from the Asset Framework on the PI Server and ingests this into Cognite RAW. Subsequently, the extractor regularly checks for updates in the PI asset framework and ingests any changes into CDF.

Delete asset hierarchies using CDF Transformations

You can now delete asset hierarchies in CDF using CDF Transformations. Items are deleted by their internal ID, and non-existing IDs are ignored. Read more about CDF Transformations.

Ingest data into CDF Relationships using PostgreSQL gateway

We're rolling out the option to use the PostgreSQL gateway and Azure Data Factory (ADF) to ingest data directly into CDF Relationships. Select the public.relationships table in your ADF sink. Learn how here.

Ingest time series data points directly into CDF Data points using the Cognite DB extractor

The Cognite DB extractor, version 2.4.1, provides a new option to ingest data points directly into CDF Data points instead of Cognite RAW. Set destination type as TIME_SERIES in your configuration file.

Early adopter programs

Cognite offers several Early adopter programs to our users. We encourage you to take this opportunity to learn about and test our features currently in the making. Navigate to Cognite Hub, open the Group tab, and select Request to join to become an Early adopter candidate.

December, 2021

Trusting the data in Cognite Data Fusion (CDF) is the core of managing, building, and using the Cognite product suite. Data engineers need sufficient insight into the staged data to take the next step on the ingestion journey and the new data profiling report on staged data in Cognite RAW caters for this.

This CDF release also introduces the new Cognite Solutions Portal. The Cognite Solutions Portal collects applications, use cases, and other helpful links to solutions your organization has built on top of CDF. Users no longer have to keep track of many different URLs to access the information they need in their daily work.

Read more about this and all the other improvements for the CDF December release below.

Data profiling on staged data

To get in-depth knowledge about the data quality, discover patterns, outliers, and see other statistics in the new standard profiling report available on the Profile tab in Cognite RAW. Report your findings to the data owners and use this as a trigger to discuss topics such as the best fit for the primary key column and contextualization and to provide the best support for the end-users of the data. Keep iterating on the data integrations to improve the data quality and prepare the data transformation into the CDF data model. Read more here.

Get notified about interrupted data flow into CDF

Catch any issues that interrupt the data flow into CDF by setting up email notifications on the Extraction pipeline page. You can define the time condition for triggering the email. Learn how to set it up in this article.

New Transformations CLI

The new Transformations CLI replaces the old Jetfire CLI offering a better developer experience. Now, you can easily declare and manage variables in the configuration file without any hard-code. You install the CLI using the Python pip package manager.

Read more here.

APIs and Python SDK for Transformations

The Transformations APIs and Python SDK are promoted to Version 1. Using the APIs/SDK, data engineers can orchestrate transformations sequentially, making it more reliable and quick. Check out the API docs and SDK docs for more information.

Access management for SQL Transformations

You can now manage access to SQL Transformations using the new transformations:read and transformations:write capabilities in your CDF group.

We still support transformation access using the transformations or jetfire groups for existing users to ensure backward compatibility. However, we recommend that you switch to managing access to Transformations using the new capabilities.

Introducing the Cognite Solutions Portal

As companies ramp up their digitalization and transformation efforts, the number of applications, dashboards, and use cases increases rapidly. As a result, end-users have to keep track of many different URLs to access the information they need. This is the problem Cognite Solutions Portal sets out to solve. It gathers all your CDF-enabled solutions in one place.

Use the Cognite Solutions Portal to add applications, dashboards from analytics and visualization tools, and helpful links into shared spaces.

Explore data in 3D

The CDF Data explorer already helps solution builders and data scientists find, validate, and learn about the data in CDF. Get the full experience by navigating and searching for assets and viewing the details in 3D models on the new 3D tab in the CDF Data explorer.

Cognite Charts

Cognite Charts runs on top of CDF and is a powerful tool for engineers and domain experts to explore, trend, and analyze industrial data. For more information, visit the Charts Early Adopter Group on the Cognite Hub.

This release has the following improvements:

Automatic data alignment

Charts now automatically handle data alignment in your calculations. Time series data often have different sampling frequencies and time stamps, and it can be hard to do even the simplest calculations (e.g. timeseries_1 + timeseries_2), especially if you’re not proficient in Python. Calculation results will be inaccurate and untrustworthy without properly accounting for data alignment.

A new and improved no-code calculation builder experience

The no-code calculation builder has been redesigned and rebuilt on a new, powerful library.

October 2021

This release of Cognite Data Fusion (CDF) contains enhancements to all capabilities for ingesting, managing & building trustworthy industrial data products to be used for data-driven decisions.

Data engineers need observability to inspect, monitor, and debug solutions in production. Therefore, we’re introducing Extraction pipelines where you can monitor the status of data ingestions to make sure reliable and trustworthy data are flowing into the CDF data sets. When you set up extraction pipelines, you can add comprehensive documentation and email alerts. You’ll be instantly notified, can quickly start troubleshooting, and have on-the-spot contact info to data set owners and other stakeholders if ingestion issues occur. You create and view these pipelines either from the Data set lineage page while you are already working with a particular data set, or you can get a bird’s eye view across several data sets via the Monitor extraction pipeline page. Read more.

If you’re using the PostgreSQL gateway, you can add status reporting to your Azure Data Factory pipeline. If you prefer working more programmatically, the new version of the Python Extractor Utils allows building extractors with status reporting, or you can use the REST API or Python SDK. The Cognite Extractors support status reporting from our next release.

Running SQL transformations using APIs and the Python SDK significantly improves the developer experience as data engineers can manage transformations programmatically. Using the APIs/SDK, data engineers can orchestrate transformations sequentially, making it more reliable and quick. Check out the API docs and SDK docs for more information. Note that the Transformations APIs and Python SDK are in public preview and will be promoted to V1 (production use) in November 2021.

Data discovery by contextualizing engineering diagrams, typically P&IDs, has already shown its value in the market. In this release, we’ve redesigned and enhanced the Create interactive engineering diagrams process to give a delightful user experience. The new sidebar navigation guides you carefully through each step in finding, extracting, and matching tags and linking these to the asset hierarchy and other associated resource groups. New actions that improve the quality of the diagrams include approving and rejecting automatically detected tags, clearing all tags on a diagram, and better name-mapping and use of synonyms in tag detection. When you’re done creating interactive diagrams, you can convert the approved PDF files to SVG if this is your preferred format. Read the How-to guides.

The solution builders and data scientists need transparent and easily accessible documentation and information about data science scripts and models to make correct and informed operational decisions. You’ll find it all in the Cognite Industrial Data Science Library.

Industrial data analytics must be of high quality and Cognite Charts is focused on the nitty-gritty details and to give you a smooth charting experience. You’ll find function descriptions by selecting the Information icon located next to a function. Notice also that named inputs/outputs in Cognite Charts make it clear to see which are required for a function. When you zoom in to a specific point on a time series, the aggregated values automatically switch to showing the raw data. In addition, all measurement units stored on time series in CDF are now displayed in Cognite Charts.

For the solution builders, we’ve enabled client credentials grant flow in Grafana. In some cases, for example, if you're using the Grafana free tier, you can not set up an identity provider for the whole Grafana instance. Instead, you need to set up a client credentials grant flow for each instance of the Cognite Data Source. You’ll find all the information you need to set this up in this article.

For the CDF administrators, we’re introducing a new token session service for managing internal sessions and exposing internal and external endpoints for interacting with them. The token session API service allows users and service principals outside the API to run jobs within the API. External principals can use the sessions API to delegate their access to functionality in CDF. You can use this functionality to set up and manage long-lived or timed access for internal services. The access is rooted in the respective principal's external identity provider (IdP), from where it can be controlled or terminated. For example, a user can specify a function to be run on their behalf and terminated if their user account is deleted.

August 2021

Today, we are happy to announce the release of the following improvements to Cognite Data Fusion (CDF).

Manage RAW foreign table in the Postgres Gateway

You can now manage the RAW foreign table in the Postgres Gateway using APIs and don’t have to rely on external tools such as pgAdmin or psql CLI to create, list, update or delete the RAW foreign tables.

Update labels on assets

To make it easier to update labels on assets, we have added a set method in the updateAssets operation. The operation accepts a list of labels to set or replace for the resource.

Update sequence configuration

With the availability of mutable sequences, you can now update an existing sequence configuration. In addition to adding, removing and updating columns in your sequence, you can also update or clear the assetId, externalId, metadata, and the dataSetId for a sequence. To update a sequence, you need sequencesAcl:WRITE capabilities.

Group limits

To support authentication for users who are members of a large number of Azure AD groups we have increased the default group limit token configuration to 1.000 for new CDF projects with AAD as the IdP from now on.

Interactive engineering diagrams

We’re hard at work putting the final touches on our new user experience for working with interactive engineering diagrams. Stay tuned for the upcoming release.

Cognite Charts

The main new features in this Cognite Charts release are:

• Search for time series data by time series ID
• Highlights matches in search results
• Recently viewed tags and time series are displayed in the search panel
• Merge y-axes with the same units
• Show/hide min/max bands
• Show/hide gridlines
• Backend performance improvements
• Bug fixes & UI/UX improvements

Search for time series data by time series ID

We have added a tab in the search panel to search for “Time series ID,” specifically. This tab should be used when you know the name of the time series you are searching for (e.g. VAL_21_PT_1019_04:Z.X.Value), while the “Tag number” tab should be used to search for the asset tag to which the time series of interest is related (e.g. 21PT1019). You will also notice that search results that match your query are now highlighted to make direct matches easy to see.

You’ll also see the tags (assets) and time series you have recently viewed (added and/or removed from your chart) in the search panel, if you have not begun to type a search query.

Basic Statistics & Tag Metadata

Users can view additional basic statistics (mean, std. dev., etc.) for the a given time series for the time range they’re currently viewing in the chart by selecting the corresponding information icon. By selecting the “Metadata” tab in this panel on the right-hand side of the screen, can view the metadata information.

Merge y-axes with same units

It’s now possible to easily compare the values of two or more time series or calculations that have the same unit, without needing to manually match and align the axes individually. Simply select the y-axis button found just above your chart and select the “Merge units” toggle. In order for this feature to work, you must have already assigned the input and output units on the time series or calculation(s) of interest.

Show/hide min/max bands

While looking at a wider range of time, Charts will show the aggregated values for a given time series. With the min/max bands, it’s possible to visually display the min and max range for a time series.

Show/hide gridlines

Gridlines can be a valuable way to visually identify time series values, but they could also get in the way and be confusing when you have a lot of time series data on your Chart. Use the show/hide gridlines toggle to decide for yourself whether or not you want them displayed on your chart.

June 2021

In his release we are adding a PostgreSQL gateway to stream data into CDF from your existing ETL solutions or push data directly to the gateway from extractors that support Postgres.

CDF Transformations now support OpenID Connect

You can now use OpenID Connect and your existing identity provider (IdP) framework to manage access to CDF Transformations securely. We currently support Azure AD, Microsoft's cloud-based identity and access management service.

When you have registered CDF Transformations in Azure AD, users can sign in with their organizational ID to transform data in a CDF project.

You can update existing transformations that are currently using API keys to use OIDC client credentials instead.

NOTE: CDF projects running in Google Cloud Platform need to be added to an allowlist (sometimes called a whitelist) to support scheduling of transformations using OpenID Connect. Contact your Cognite representative to be added to the allowlist.

Learn more in Setup and administration with OpenID Connect.

PostgreSQL gateway

Use the PostgreSQL gateway to ingest data into CDF from popular ETL solutions. The CDF resource types appear as tables in the PostgreSQL database and you can ingest data directly into CDF resources like assets, events and datapoints and to Cognite RAW.

• We currently support Azure Data Factory as the ETL tool.
• The PostgreSQL Gateway is intended for ingestion only. We do not support querying data from CDF using the gateway.

Grafana - nested variables

In Grafana, you can now link variables and use the value of one variable as input to another.

Learn more: Nested (chained) variables

Sneak peek at the new interactive diagrams experience

We’re excited to give you a sneak peek of the latest redesign and enhancements to the interactive diagrams experience before it’s released publicly.

Power BI - templates

We have added support for Templates in Power BI to early adopters. Contact your Cognite representative to give it a try and share your feedback!

April 2021

This release of Cognite Data Fusion (CDF) focuses on the end-to-end data journey with fast and secure authentication to all Cognite applications using your organization's IdP. We currently support Microsoft'sAzure Active Directory (Azure AD). Speed up the time spent getting value for operations using a new sample function for contextualization and add events to a Grafana dashboard for visualizing and analyzing your CDF data.

Manage access with OpenID Connect

Register the CDF portal application and other Cognite applications in your IdP (Identity Provider) and use OpenID Connect and your IdP framework to manage user and service principal (app) identities securely. We currently support Microsoft's Azure Active Directory (Azure AD).

Visit the Manage access to CDF getting started course to learn more about the basic authentication concepts and terminology, secure access to CDF, and the different ways an application can access CDF data. Explore the docs for the technical details.

NOTE

With the introduction of OpenID Connect and the IdP framework to manage CDF access securely, we strongly encourage customers to adopt the new authentication flows as soon as possible.

SQL Transformations CLI and Cognite Extractors support OpenID Connect authentication

Transformations CLI users, scheduled transformation jobs, and Cognite extractors can now authenticate using OpenID Connect and Azure AD.

Accelerate data set contextualization

Speed up your contextualization with the entity_matching.suggest.fields function. Supply the function with data samples to return suggested fields you can use for entity matching in the API, SDK, or UI.

Use existing matches to automatically generate matching rules to apply to all your data.

Add input naming variations to the entity matching model to improve the suggested matches, for example, pmp for pump and bhp for bottom hole pressure. To create a list of synonyms, use replacements in the API.

Visualize, track, and analyze events in Grafana

Boost your insights by adding the CDF events resource type to your Grafana dashboard. To visualize events, you can customize the time range and events to display and rename and organize columns according to your needs.

By default, the events annotation query returns events that are active within a time range, but you can customize the query with additional time filters.

Learn more: Visualize events

Templates (Early adopter program)

With Templates, you build your view of the data you have available in CDF and simplify the applications and solutions you are working on by accessing data through templates. Templates remove the gap between the application’s data model and the preexisting structure of the relevant data. It is easy to scale your solution across more data without changing or redeploying your application code or configuration. Instead, you can work with your template in CDF, and use the tooling available to scale to more data with governance.

Learn more: Manage templates

Charts (Early adopter program)

Use Charts to explore, trend, and analyze industrial data. Find, understand, and troubleshoot for actionable insights from time series and contextualized P&IDs already in the CDF portal application or other Cognite applications then share the chart for collaboration. Charts runs securely with a single, secure sign-in.

Learn more: Get started with Charts

informare

To join an Early Adopter program, contact your Cognite representative.

February 2021

This release of Cognite Data Fusion (CDF) focuses on on usability improvements across CDF as well as laying the foundation for existing future features. We are also very proud of our Cognite Power BI Connector, which is now certified by Microsoft.

The Cognite Power BI Connector is out of Beta

We're excited to announce that Microsoft has certified the Cognite Power BI Connector and that the connector is now out of Beta. The Cognite Power BI Connector enables data consumers to easily read, analyze, and present data from Cognite Data Fusion (CDF) in compelling visualizations in Power BI Desktop and the Power BI service.

You can find the connector in the Other category of the Get Data dialog in Power BI. Learn more in our in-depth article.

Enrich contextualized assets with 3D models

Increase the value outtake of contextualization by connecting assets to a 3D model with the new easy-to-use option under Match entities in the CDF user interface. Visually inspect assets and zoom into details to get tangible information.

Learn more: 3D contextualization

Accelerate finding and filtering relevant data

Finding the data you need is now even easier in the CDF Data explorer. Navigate between different parts of CDF with the new drop-down navigation in the top bar and shift between multiple CDF resources with more descriptive tab names.

Use the new Quick search in the top navigation to search for the resource names and explore data from anywhere in CDF. Filter on metadata and hide the empty fields for any resource and show aggregated values of metadata keys for assets to get unique values ordered by frequency (if enabled in the API). You'll also notice that date points are added to the time series sparkline to better visualize missing data for a given range.

Learn more: Data explorer

Labels and relationships in SQL transformations

Create and delete data related to the Relationships and Labels resource types when you use SQL queries in CDF Transformations to transform data from the CDF staging area into the CDF data model.

Learn more: CDF Transformations

Enhanced results page for entity matching pipelines

Get more information about the results, rules, and rule conflicts for matches from your Entity matching pipelines in CDF and improve rule predictions by selecting particular matches to CDF.

Learn more: Entity matching

December 2020

This release focuses on improving access and discoverability of data and workflow automation. Cut down on time you spend trying to find data, make sense of it, and then deploy and monitor it. We deliver tools to speed up this process and allow you, the user, to compound the value of your work. Improved performance and capabilities for your digital teams means a faster time to value for operations.

Explore and discover the right data for your solutions

Use the CDF Data Explorer to find, validate, and learn about the data you need to build solutions. Browse through all the available resource types in your CDF project and drill into details and linked resources, for example, assets and time series with live data, interactive P&IDs, and mapped events.

Learn more: CDF Data Explorer

Configure and rerun contextualization pipelines

Create a pipeline to re-run matching models on data sets. If the data set receives new data, you can re-run the pipeline to find additional matches.

Learn more: Entity matching

Enrich files with geographic location

The new geoLocation field for the Files resource type lets you contextualize and find documents or files related to geographic locations. For example, find seismic reports for an area or drone survey photos from a yard section.

Learn more: Geographic location of files

Monitor your SQL transformations

Subscribe to email notifications to monitor the transformation process and solve any issues before they reach the data consumer. You can add up to 5 email addresses, either to groups or to specific people.

Flexible data modeling with relationships

This release sees the relationships resource type moving from Beta to API v1.

While you can use the assets resource type to model equipment relations as a tree, relationships let you model data in additional graph structures meaningful for your organization.

Data engineers can use relationships to organize assets into multiple structures. For example, you can order assets by the process flow or the physical connectivity in a grid structure to let users efficiently locate data for nearby equipment.

Some users in your organization may find it useful and efficient to organize the equipment by its function in a maintenance hierarchy. Others may benefit from having the equipment organized by physical location in a location-based hierarchy:

See Modeling asset structures with relationships for more examples.

Beyond structuring assets, you can use relationships to create richer connections between data elements and build a knowledge graph on top of the existing data.

To learn more about how relationships can represent industrial reality, we recommend reading the "Building a contextualized power system network model" whitepaper.