Release notes
This article documents the ongoing releases of Cognite Data Fusion (CDF) features and products.
June 2024
These features will become available in June 2024.
New and updated features
Cognite Data Fusion
On the CDF homepage, we're introducing a sidebar for accessing your tools and new workspaces with groups of related tools. Switch between the workspaces by selecting a workspace name:
- Industrial tools - Explore, analyze, and trend data using search, canvas, and charts. This is the default workspace the first time users open CDF.
- Data management - Model, integrate, and transform data. We've moved some tools into the Build solutions folder and updated some tool names.
- Access - Manage access to CDF. This workspace is only available if you have access management rights.
Charts now indicate data quality. Uncertain data points appear as shaded lines and bad data points appear as a gap in the chart.
For search
- Select
to sort and select columns. Currently, you can sort and select the default categories. Space may limit the number of columns displayed.
- Admins can create filter combinations, such as latest revisions or work orders, available as Saved filters, to simplify looking up data. Contact your Cognite representative to set this up.
- The 3D toolbar now includes options to measure volumes, switch between metric and imperial units, and apply color overlays to time series.
For data onboarding
- Use the Cognite API for Data workflows to re-run failed, timed-out, or terminated workflows from the point of failure. In addition, the automatic retry function in failed workflows now works better for temporary errors in the underlying service it attempts to trigger.
- Transformations now allow conversion of source system units to units defined in CDF and selecting global data models as targets.
- Time series data points now display data quality status codes. This helps you determine how to treat bad and uncertain data points and to better visualize data when you’re plotting data points in a chart. This feature follows the OPC UA standard, and the Cognite OPC UA extractor, Cognite PI extractors, and Charts support this feature.
- Time series data point aggregates now support 1-month, 3-month, and 12-month time granularities and the ability to align them to time zones specified in your query. (Beta)
For building solutions
- Use Streamlit in CDF to build custom web applications. For instance, you can create data visualization tools, dashboards, or prototypes and make these available to end-users in the Industrial tools workspace. (Beta)
For access management
- CDF now supports using Amazon Cognito as the identity provider (IdP) for managing access to CDF.
Release states
Canvas, search, Data workflows, monitoring, and scheduling calculations in Charts, and scene configuration in the 3D setup have reached production release state.
The features described in this section are currently only available to customers via our Early Adopter program. For more information and to sign up, visit the Early Adopter group on the Cognite Hub.
- Structure data according to a predefined core data model.
- Integrate simulator data using the Cognite API.
InField
The features described in this section are currently in beta testing and are subject to change.
-
Work order tasks. Create a checklist from work order tasks.
Before, you could create a single checklist from the work order. Now, you can create a checklist from several work order tasks relevant to a particular field worker. You can also create another checklist with the remaining tasks. The work order will remain in progress until field workers complete all tasks in the work order.
-
Delete checklist. Delete a checklist from the field worker's work plan.
You can only restore the deleted checklist through the Cognite API. If the field worker collects the data before the checklist is deleted, the data is saved and stored in InField.
-
New mobile landing page.
This page is dedicated to data exploration on mobile devices and includes an updated sidebar for easy navigation between exploration, checklists, and observations.
-
Create and customize observations.
You can create observations on all devices. If you use SAP as your work management system, you can send the completed observations to SAP.As an admin, you can configure observations. You can select what fields to include in the observations, how to name the fields, and what observation types and priorities there are.
-
Show or hide functionality.
When configuring InField, you can select what functionality to turn on and off for users in each location. You can also turn off all functionality to access the data explorer only.
InRobot
The features described in this section are currently in beta testing and are subject to change.
-
Plan missions without robots. (private beta) You can create or edit missions without controlling the robot and using the 360-degree images it has previously taken. As you work with the images, you can move the camera to find a new position for the robot to inspect.
-
Automatic position saving.
Now, you don't need to use the Save position button to save the camera position change in a mission, as InRobot automatically saves the camera position and its values.
Deprecated and retired features
A new runtime for Cognite Functions has been rolled out. Functions created before March 22, 2024 on a Google Cloud cluster will need to be re-created to continue using Cognite Functions. The old Cognite Functions runtime in Google Cloud clusters is deprecated from April 23, 2024 and will be retired from April 23, 2025.
See also: Deprecated and retired features.
Resolved issues and minor updates
Cognite Data Fusion
Canvas
- When you add data, a select all checkbox for filters is available when you expand a resource type.
Search
- Filter buttons display the number of applied filters.
- Sort results within a category in the side panel in 3D.
- Filters used
AND
between the selection of several values for a key. This has been corrected to useOR
.
For data modeling
- Views with no filter no longer count or list all instances in the CDF project.
- Query responses in the query explorer now include the request made to the Data Modeling Service (DMS) in a GraphQL format.
For contextualizing data
- When you selected candidate assets for searching within a diagram in Diagram parsing, only the first 1000 labels were available for filtering. Now, all labels are available for filtering.
InField
-
Fixed the issue where the deleted templates in the Draft or Ready status appeared on the Deleted tab with the unchanged status.
-
Fixed the issue where the values captured for the second time series could be lost when adding the same time series for two tasks in the same template. Now, both tasks show the captured values when viewing the completed checklists.
April 2024
Cognite is moving to a quarterly release cadence. The next main release is scheduled for June 2024.
New and updated features
Cognite Data Fusion
In Charts:
-
To assess monitoring jobs, use Alerts in selected time frame. This section displays the number of alerts that would have been triggered based on your settings. Use this info to determine appropriate alert threshold values. (Beta)
-
For a detailed view of time series values at a specific moment, select Slider from the tools menu. Use this setting to compare different time points and observe trend changes.
-
The maximum number of individual data points in a chart increases from 500 to 100,000.
On Canvas:
-
We're introducing a new user experience for finding and adding data to a canvas. Select Add data, enter a query in the search field, then use the left sidebar to filter the search results by category and the Filters button to refine each category. This user experience aligns with how you find data in CDF.
-
To collaborate with colleagues who haven't signed in to CDF, share your canvas by entering their email address under Share. They'll get an email invitation with a link to the canvas, and will need to authenticate to get access.
In Search:
The features described in this section are currently in beta testing and are subject to change.
-
Sort names or counts in ascending or descending order (
) in the search results, in the list of categories, and on the data on the search details pages.
-
The sidebar has two sections: a set of default categories that apply to all data models, and a list with other categories that adapt to each company's specific data model.
-
If you search using Copilot, it identifies relevant categories and applies filters to the search results. You can modify the filters or select a different category to adjust the results.
-
To visualize data on an X- and Y-axis, select the statistics icon on the Copilot results page. Note that this feature is only available for the categories listed under Other categories.
For setting up 3D content:
Set thresholds for your 3D environment to highlight important attributes or criteria and identify patterns and anomalies in your scenes. Visualize the thresholds in the 3D scene by applying a color overlay.
For access management:
We're introducing group membership within groups in Manage Access.
To give access, admins previously had to create groups in their IdP, add users to these groups, and then link the IdP groups to groups in CDF. Now, admins can directly add users to groups within CDF, streamlining the access management process. You can also use this feature when you create or edit a group.
When you've added the required capabilities to the group, select an option under members:
- Externally managed: Provide the group ID of a group with users in your IdP. This is the existing solution.
- List of users lets you add and remove users. The listed users will have access given by the capabilities in the group.
- All user accounts gives access to capabilities in the group for all user accounts in the organization. Use this option carefully, it may lead to unintended access granted to every user in the organization.
For data onboarding:
-
Use the new Cognite Kafka extractor to extract data from Apache Kafka.(Beta)
-
Use the Cognite File extractor to extract documents from OpenText Documentum and OpenText Documentum D2. You'll also find these improvements to the file extractor:
- In the configuration file:
- Use the new
filter
section for advanced filtering logic. - Use the new
delete-behavior
section to detect hard or soft-deleted files. - Use the new
metadata-to-raw
section to ingest file metadata to a table in CDF RAW.
- Use the new
- For connections to Sharepoint Online sites:
- Connect to multiple sites using the
paths
parameters. - Configure sites by pasting the URL directly into the configuration file.
- Dynamically discover sites by adding several sites to the
filter
section.
- Connect to multiple sites using the
- The file extractor now supports ingesting files larger than 5 GiB.
- In the configuration file:
InField
The features described in this section are currently in beta testing and are subject to change.
- Manage columns. Customize the Overview page.
Add, hide, or rearrange the columns to view the information that's more relevant to you.
-
Work order details. Combined the Assets and Operations tabs.
Now, you can find information about assets and tasks to be performed under one tab. Open work order details and select the Operations tab to see field workers' tasks and the work center information. Expand the task to see if it applies to several assets. -
Overview filters. Save your favorite filters and use them as default.
On the Overview page, use filters to get the most relevant data and save the filter selection to use next time. You can apply one of the saved filters based on your needs or set the filter as default.
InRobot
The features described in this section are currently in beta testing and are subject to change.
- Robot selection. Select a robot when needed.
Before, you had to select a robot when you started using the application or switched from one tab to another. Now, the robot you used the last time will be selected automatically, and you can switch the robot at any time.
Resolved issues and minor updates
-
Filter settings are kept while you browse the details tab in Data Explorer and Search.
-
The filtering logic for
And
andOR
operations are adjusted in the Data Explorer.
Deprecated and retired features
-
Cognite Documentum extractoris deprecated from April 2, 2024, and will also be retired from April 2, 2024. Support for OpenText Documentum and OpenText Documentum D2 has been integrated intoCognite File extractor. -
Support for Python 3.8 as the default Python runtime in
Cognite Functionsis deprecated from March 11, 2024 and will be retired from October 1, 2024. The default Python runtime inCognite Functionsis updated to version 3.11.
See also: Overview of deprecated and retired features.
March 2024
Watch the summary in the product release spotlight.
New and updated features
Cognite Data Fusion
On the Canvas:
-
Add charts to your canvas from the Add data option on the canvas or from Open in Industrial canvas on a chart. The chart on the canvas includes any threshold values and time series calculations. To edit a chart, select Open in Charts from a time series. (Beta)
-
Create plans and diagrams, such as cause map diagrams, by adding sticky notes using the dots around an existing sticky on the canvas. Drag a dot to create lines between the sticky notes. (Beta)
In Search:
-
If you browse a 3D model from the search page, you'll find additional options for navigation and visualization:
-
Orbit mode: Rotate around objects to see all sides.
-
Fly mode: Look around the exterior or interior of a closed room.
-
Move instantly to any spot by double-clicking anywhere in the 3D model.
-
Color overlay: Use this option on the toolbar to highlight objects on the model. Your CDF admin predefines the options on this list. (Privat beta)
-
For data onboarding:
-
Data workflows is a new managed process orchestration service to coordinate interdependent processes, such as CDF Transformations, Cognite Functions, requests to the CDF APIs, and other data processes. (Beta)
-
By aligning all 3D content, such as point clouds and CAD models, in a location, the users will get better context and understanding of the physical conditions of a location. You do this by configuring a 3D scene under Set up 3D content. You need a scene to view 3D models from the search page.
-
Run CDF Transformations incrementally for transformations that read data from a CDF data model. CDF will only read and transform data that has changed since the last run. (Coming soon)
-
Assign units from the CDF unit catalog to time series instances and to
float32
andfloat64
base type for data models. For unit-aware time series and data modeling properties, you can request unit information and consume data in a compatible unit. CDF handles the unit conversion automatically. -
If you're modeling data using the CDF user interface, you can now see how relationships of data is stored in containers, what data can be queried (the views/data models), how graphs are constructed (containers), the relationships between data objects (edges and direct relations), and how these are consumed (from views and data models) by queries.
-
In-product guides are available for onboarding new users to
Chartsand the 3D view on the search page.
For time series:
-
Subscribe to one or multiple time series to automatically obtain the latest data points or changes to data points for one or more time series. This is useful if you keep a chart or a dashboard up to date with the latest time series values or need data points to perform calculations.
-
Time series data points now display data quality status codes to help you determine how to treat uncertain data points and better visualize data when you're plotting data points in a chart. The implementation follows the OPC UA standard, and both the Cognite OPC UA and PI extractors support this feature. (Beta)
Jupyter Notebooks
-
Open Jupyter Notebook directly from the CDF staging area (RAW) and the data model user interface. (Beta)
-
Jupyter Notebook copilot is improved, and better understands CDF and the Cognite Python SDK. (Beta)
New Python data modeling SDK generator
- We're introducing Pygen, a Python data modeling SDK generator. Pygen is a Python package and a command-line interface for generating Python SDKs from CDF data models. (Beta)
InField
The features described in this section are currently in beta testing and are subject to change.
-
Conditions. Set conditions to tasks.
Add actions for the field workers to perform depending on the task state. In the first implementation, you can show a message with instructions, questions, etc. when adding a template task. -
Device mode. Set a default mode for
InField.
Switch to a mobile or a desktop version of the application on your device and make it the default. The setting doesn't affect the mode of other devices. -
Overview filters. Search and filter the Overview page.
Search for checklists and work orders by name and filter on the checklist status. -
Checklist date. View the checklist creation date.
In the list of checklists, check the date when each checklist was created, along with the day of the week and time. -
Schedule. Add monthly and yearly intervals.
Create daily, weekly, monthly, and yearly schedules for checklists to perform at regular intervals. -
Templates. Hide the templates list.
Hide the panel with the list of all created templates while creating a template, adding tasks, and viewing asset information. -
Offline mode. Improved data storage.
If the users have a slow internet connection for more than 5 seconds, the application switches to offline mode. Users can upload the data when the connection is back. -
Observations. Updated observations type and priority.
Select a priority option from 1: Immediate to 5: Greater than 8 weeks and one of 5 observation types (M1, M2, M4, M5, M8).
InRobot
The features described in this section are currently in beta testing and are subject to change.
-
Video. Record videos of up to 60 seconds of assets in motion. For example, record a video of a water pump to see the water flow.
-
Waypoints. See the direction of the robot’s movements on the 3D map with the help of cone-shaped waypoints.
-
Move map to model. Move the waypoints to the 3D model. Adjust the position of waypoints if needed.
-
Media preview. In Reports, see which runs include images and videos.
-
Filter missions. In Reports, search a mission by name to find the mission of your interest faster.
Resolved issues and minor updates
Cognite Data Fusion
In Charts:
-
If you manually set the range of an axis, an indicator and a button appears where you can reset to automatic range mode.
-
Function descriptions are now available in all the languages CDF support.
On the Canvas:
- You can now paste local files directly onto the Canvas using Ctrl + V (
Windows) or Cmd + V (macOS).
In search:
-
If you're using CDF in Japanese, the kana-kanji conversion now works correctly.
-
The related asset count on the asset details page now shows all related assets. Previously, this count had a limit at 1000.
-
Search for events using metadata ID is improved.
InField
In InField, we've resolved these issues:
-
You won’t see information about a previously selected asset when switching from one checklist to another.
-
After the mobile users enter a numerical value, the application won’t jump to the next numerical reading and skip the tasks in between.
-
When adding a description to an observation, the users will stay on the same step unless they select the next or previous step.
Deprecated and retired features
See Overview of deprecated and retired features.
Cognite API updates
To see changes to the Cognite API, visit the API changelog.
January 2024
Watch the summary in the product release spotlight.