What's new in 2023

​

New and updated features

​

Cognite Data Fusion

• Use the new search on the CDF home page to find data for your daily tasks. The search results show all connected (contextualized) items to give the full context of your data. You can open the results directly on the Industrial canvas or Charts for further analysis and collaboration. (Beta) You can also find data using Cognite AI (artificial intelligence) for industrial data. Select the Search using AI tab to try one of the example questions or write your own. (Beta)
• We’ve added several features to the Industrial canvas. Copy content between canvases, duplicate canvases, and select which properties to show on asset cards. (Beta)
• In Charts, create a calculation pipeline by saving, scheduling, and monitoring calculations. (Beta)
• In the Data explorer:
  • Filter assets, time series, files, events, and sequences by all linked resources, directly linked resources, and relationships. For assets and files, you can also filter by annotations.
  • Filter by Parent and Child under Assets in the sidebar.
• Jupyter Notebook with AI copilot is now an integrated part of CDF. Use Cognite AI to write and understand code or explain scripts from others. Notebooks run in a sandboxed environment inside the browser using the current user credentials. You can share notebooks with your coworkers. (Beta)
• To search for equipment using 3D models, admin users can manually link objects or areas in CAD models and point cloud models to equipment and update existing links between 3D objects and tags. (Beta)
• The new Cognite OPC Classic extractor reads time series and asset information via the OPC DA and HDA protocols. (Beta)
• User profiles are now generally available. When activated by a CDF admin, user profiles let users share data and mention their coworkers.
• For Model your data, we’ve made these improvements:
  • When you open the code editor without being in edit mode, you’ll find links to Preview data and Transform data above each data type.
  • In the Types section:
    • The Add type button is now located in the header panel.
    • Search for data types in the Search field.
    • Select Type or Interface when you add a type.
    • Each type is labeled with additional info, such as import and read-only directives.
  • In the GraphQL section, you can use the @default directive to set the default value for a property. For instance: type Pump { weight: Int @default(value: "5") }

​

InField

• Offline mode. Complete operator rounds and work orders without network connectivity. Open the checklist on your mobile device before performing tasks, and if you go offline, you can still complete your tasks but with limitations. When offline, you can’t access the asset explorer, upload media, or create observations.

​

InRobot

• Mission scheduling. Automate robot missions. Plan single or recurring autonomous robot missions, set the date and time of the mission, or skip one of the scheduled mission runs.
• Gauge details. View the gauge type and gauge values in the reports.
• Gauge asset metadata. Edit the gauge asset metadata in reports to improve gauge reading functionality.
• Time series access. Navigate from Reports to Data Explorer to analyze time series.

​

Resolved issues and minor updates

​

Cognite Data Fusion

• In the Data explorer, we’ve resolved these issues:
  • On the Asset tab:
    • If you select an asset, you automatically navigate to the same asset when you open the Hierarchy tab.
    • The asset hierarchy only displayed if the root asset was displayed on the first page of the results.
  • On the Files tab:
    • Some files were incorrectly linked to an asset.
    • If you added multiple tags to an engineering diagram, the Select button would show as deactivated.
  • On the Details tab:
    • The Label field now displays the same name as in the source system.
• On the Industrial canvas, we’ve resolved these issues:
  • When you add data to a canvas, the Load more button and the date selector for time series are easier to access.
  • If you added a rectangle around an engineering diagram, you couldn’t interact with the annotations.
  • Lines didn’t display correctly on the engineering diagrams.
• In Charts, we’ve resolved these issues:
  • The chart now previews a threshold line when you configure a monitoring task.
  • If you monitor time series, the email alerts contain more context for threshold breaches.
• In the Create interactive diagrams, we’ve resolved these issues:
  • When you selected a set of assets to link to a diagram, some assets were excluded as potential candidates. All selected assets are now considered for linking with the diagram.
  • When you linked to other engineering diagrams, More filters didn’t display all the values correctly.
• On the CDF home page, we’ve resolved these issues:
  • If you’ve worked with Charts and Industrial canvas, these are now added to the Recent activity section.
• For Access management, we’ve resolved these issues:
  • Some users got an incorrect Access required message when they signed in to CDF.
  • Access was denied if you closed CDF without signing out and then re-opened CDF with a URL address that included the CDF project.
• For Model your data, we’ve resolved these issues:
  • If you created a data model using the CDF CLI, it wasn’t possible to add a description.
  • On the Data management tab:
    • The knowledge graph icon didn’t open GraphQL.
    • The instance count didn’t show the correct numbers.
  • The scroll bar for selecting a relationship when you create a transformation didn’t scroll.
  • The field name would disappear when you added a type.
  • Reference nodes didn’t load correctly.
  • If you deleted a type from the code editor and switched to the list view, CDF stopped responding.

​

Changes to Cognite Functions on Google Cloud Platform

​

Deprecated and retired features

​

Cognite Data Fusion

• Automatic Identification and Reporting (AIR) is deprecated from October 6, 2023, and will be retired from December 31, 2023. The core functionality of AIR has been integrated into Charts.
• Asset Data Insight (ADI) is deprecated from October 5, 2023, and will be retired from December 31, 2023. Charts, Industrial canvas, and Data explorer are available through fusion.cognite.com to replace the key ADI workflows.

​

Cognite API updates

​

Enhancements

• Work in your preferred language in InField, Maintain, Charts, Industrial Canvas, and the Data Explorer. Navigate to Manage account on your user profile and select among the languages listed below. This feature is in Beta. Deutsch - English - Español - Français - Italiano - Nederlands - Norsk - Português - Svenska - 한국어 - 中文 - 日本語
• Collaborate on the data on a canvas, for example by entering comments and tagging co-workers. Select Share to give co-workers access to the canvas. This feature is in Beta.
• You can now use data from your custom CDF data models in Power BI, and use GraphQL mutations to update your data model data.
• Use data point subscriptions to configure a subscription to listen to changes in one or more time series. A time series may be part of many subscriptions. Use this feature if you need to keep up to date with changes to one or more time series without re-ingesting the entire time series. See also the API documentation or try it out using the Python SDK. This feature is in Beta.
• We’re releasing the Cognite File Extractor into general availability and upgrading the Cognite DB Extractor to version 3 with the following enhancements:
  • Ingest data into the CDF asset and event services by structuring the query to return keywords as column names. You can also write a table to CDF sequences, and if the database contains binary data, you can upload it to CDF files.
  • Native support for databases, such as PostgreSQL, Snowflake, Azure Cosmos DB, and MongoDB, means you can connect to the extractor without using Open Database Connectivity (ODBC) drivers.
  • Schedule queries with cron expressions or intervals, for example, 6h or 15m. Disable scheduling with a global configuration parameter while leaving the schedule keyword in the query configuration, for instance, for debugging or manual runs.
• Ingest data into CDF using the MQTT streaming service~. Cognite’s infrastructure hosts the extractor, and you configure the extractor using CDF to connect to an MQTT broker. You listen to data by subscribing to topic filters and specify the message format for the extractor to ingest data arriving on the configured MQTT topics. This feature is in Beta.
• In the Cognite Python SDK, you can now use advanced search and filtering on metadata across events, time series, asset, and sequences, using the .filter() method, for example, client.events.filter.
• In Cognite InRobot, you can:
  • Pause/resume missions as you navigate the robot or when it performs missions autonomously.
  • Cancel missions, but pause the mission before you cancel it.
  • Review old and new images of inspection points on the Actions report.
  • The robot can return to the dock without the docking station in sight.
  This feature is in Beta.

​

Limited availability

• We’re releasing new experiences for Cognite Maintain and [Cognite InField]. This includes a new user interface and functionality for both applications to streamline the Cognite asset performance management offering.
• Create a calculation pipeline in Charts by scheduling and monitoring calculations. Use the option Save and schedule to set the run intervals. Set up monitoring of time series and calculations together. If a threshold is breached, subscribers will receive an email notification. Beta.

​

Deprecated features

• Starting September 1, 2023, we’ll no longer develop new features for Cognite Remote. See Deprecated and retired features for more information.

​

Resolved issues

• For data transformations, we’ve resolved issue where long-running transformations timed out due to driver restart errors.
• For the Cognite extractors, we’ve resolved an issue where some users experienced timeouts when running the Cognite DB Extractor. Note that the recommended size of the upload queue is 50 000 rows and that the query parameter should contain a where clause using the substitutions {incremental-field} and {start-at} if data is loaded incrementally.
• In the CDF data modeling framework, we’ve resolved these issues:
  • Some users got inconsistent results when listing data models using the CDF UI and the CDF API.
  • It wasn’t possible to populate two or more views pointing to the same node using transformations.
  • CDF CLI, v2.3.0: The data model name and description were deleted when you published the data model.
• In the Data Explorer, we’ve resolved these issues:
  • If you searched for a file from the CDF home page, you were directed to the file search in the Data Explorer. Now, the file opens directly.
  • Changes weren’t kept when you created tags manually on an engineering diagram and selected an asset before you saved.
  • It wasn’t possible to filter by relationship on the Files tab using the tree view.
  • Some customers were not able to search in the Data Explorer.
  • The filtering of resource labels didn’t limit the labels according to the filtering.
  • The file number count for a document category and linked files weren’t aligned.
  • The linked asset count on the File tab in the Data Explorer and the count from the Cognite SDKs weren’t aligned.

​

Enhancements

• When you open the CDF portal application, you’ll find a new home page with direct access to popular features. Select a card to open a feature or select View all to see all features.
• Enhancements to the CDF data modeling framework include:
  • Use the Browse library feature to select predefined data models you can tailor to your industry standards.
  • Display time series data from CDF data models in the Grafana connector.
• Enable user profiles to let users share data and @mention other users.
• Extract data from SAP with the new Cognite SAP extractor.
• Fine-tune the results in the Data explorer with dynamic filtering for units and metadata values.
• Specify a data set when you upload files or functions to CDF and filter on data sets on the Files tab in the Data explorer.

​

Enhancements to features in Beta testing

• We’ve released a beta version of the Cognite Industrial canvas where you can access all data, such as documents, engineering diagrams, sensor data, images, and 3D models, on a canvas.

​

Product release spotlight

​

Resolved issues

• In the CDF data modeling framework, we’ve resolved these issues:
  • The Data management page treated fields that started with = as an expression.
  • Some users received a 5xx error code when they created or updated data models.
  • Some users received a 4xx error code when they loaded the Data management page or retrieved data from the GraphQL explorer.
• For 3D models, we’ve resolved these issues:
  • We’ve improved the performance when you browse, navigate, and retrieve information in 3D models.
  • We’ve fixed an issue where contextualized assets weren’t highlighted if you opened a 3D model from the Data explorer.
• For data transformations, we’ve resolved these issues:
  • When you selected Profile to view staged data, you couldn’t sort functions in columns.
  • CDF defined the split_part Spark function as an undefined function.
• In the Data explorer, we’ve resolved these issues:
  • If you applied a filter to your data, the remaining filters didn’t update.
  • Some files were available in data sets but not in the Data explorer.
• We’ve fixed an issue where some users received a 4xx error code when they created a group in CDF Access management.
• We’ve fixed an issue where some users experienced that files were deleted from their CDF project. We’ve improved the logs to track the delete history.
• We’ve fixed an issue where a Failure Exception: CogniteDuplicate error occurred when creating or updating time series.

​

Enhancements

• We’re releasing the advanced CDF data modeling framework into general availability.
  Data models are the core of understanding relationships between data objects and establishing data products for data science models, mobile apps, and web apps. You can now express data according to your best practice or industry requirements, such as source system models, solution-specific models, or domain data models. Version the models to test, iterate, and reuse them to scale with the underlying data. You can model data using the CDF portal application and review and explore the data with the built-in query explorer.
• We now group 360-degree images from similar locations in 3D views and dim all image indicators behind geometry in point clouds or CAD models.
• Use the search parameter option next to the search bar to fine-tune your search in the Data explorer.
• Open selected time series directly in Charts with the Charts preview button in the Data explorer.
• When you create interactive engineering diagrams, we now recognize bundled tag names, for instance, Tag A/B, as separate tags.
• You can now use a key/certificate pair to authenticate the CDF extractors to Azure AD.
• 3D models visualize textured surfaces, and the Cognite Reveal 3D SDK now supports textured 3D models.

​

Enhancements to features in Beta testing

• In Charts, you can define upper or lower threshold values for time series and receive an email if the thresholds are breached.
• The Cognite InRobot beta version has been updated.

​

Resolved issues

• In Data transformations we’ve resolved these issues:
  • The transformations preview didn’t display data points with negative timestamps.
  • Transformations failed due to many WHEN statements in the SQL query.
  • Scheduled transformations failing due to service downtimes.
• In Data search we’ve resolved these issues:
  • A bug in the asset hierarchy request to CDF caused an incorrect asset sub-tree hierarchy.
  • Some file types were incorrectly sorted as Other on the Files tab.
  • If you uploaded a .zip file to Cognite Functions, the file name extension changed to .txt when you downloaded the file from the Data explorer.
  • Deleted files appeared to be available for download from the Files API and the Data explorer.
• Some users received a 5xx server error response code when they updated large amounts of assets using the CDF Assets API or the Cognite Python SDK.
• Time series matched with assets displayed as unmatched in the result preview in Entity matching.
• A blank canvas appeared when you searched on the Data tab in the Data catalog and if you created a new extraction pipeline without the extractionpipelines:read access capability.
• .svg files did not display in Charts.
• Improved wording in the error message that appears if you sign into a CDF without a project name using the Cognite Java SDK.
• When you created a CDF project, the access capability project:list wasn’t included in the initial setup of a CDF project and prevented access to the Access management page.
• The processing status on the Revision details section for 3D models incorrectly reported no logs even when logs existed.

​

Enhancements

• Transform data with a new interface in CDF Transformations.
  • You’ll find a new no-code mapping option for source-to-target fields. Map the fields manually or use CDF’s suggestions.
  • The Spark SQL editor offers built-in code completion, built-in Spark SQL functions, and built-in Cognite custom SQL functions.
• Discover gaps and deviations in time series with the new Data profiling side panel in Charts.
• View 360-degree images, either in isolation or in the context of point cloud, CAD, and BIM models in the Data explorer.
• Preview documents such as text files, JSON files, spreadsheets, documents, and slides in the Data explorer.
• Ingest data from files in JSON format to the CDF staging area (RAW).
• The Annotations API is now used as the storage mechanism for annotations in file viewers. Existing annotations have been migrated from the Events API.
• We’ve released Cognite InField versions 11.0 and 11.1 with improvements to the InField 3D model and checklists.

​

Enhancements to features in Beta testing

• Enhancements to the new data modeling feature include:
  • Transform data into and between data models using the new CDF Transformation user interface.
  • Improved architecture for reusing data across data models.
  • Advanced data modeling with inheritance and composition.
  • Versioning of data models and data model types to enable no re-ingestion of data across versions for common properties.
• Enhancements to the Data explorer include:
  • Filter data using multiple values.
  • View connected engineering diagrams side-by-side by selecting links in a diagram.
• Extract well data from the Open Group OSDU Data Platform with the new Cognite OSDU extractor. You can extract data using the OSDU generic API and the Wellbore DDMS. The extractor is compatible with Microsoft Energy Data Services.
• Extract documents with the Cognite File Extractor. You can extract files from local file systems, network sharing protocols such as FTP, FTPs, and SFTP, SharePoint Online Document libraries, Google Cloud Storage, and Azure Blob Storage.
• We’ve released a Beta version of Cognite InRobot. This new application works in sync with a robot to collect and automate data collection and inspection.

​

Resolved issues

• Cognite PI extractor error on Windows Server 2012 R2. Note that this extractor requires .Net Framework 4.8 or higher.
• The Data set list in the Quick match option in Match entities didn’t list all data sets.
• Charts would not load and displayed the error message Failed to load firebase error. Make sure to open Charts from within CDF.
• Fixed an error where scheduled transformations were deleted due to an error in the token session refresh.
• Resolved issues in the Data explorer include:
  • The filter on the File tab was case-sensitive. Now, you can enter filter criteria with all cases.
  • If you selected an asset in the list view on the Asset tab, then changed to the asset hierarchy view, the selected asset lost focus.
• Resolved issues in 3D models and Reveal include:
  • Large models with metadata weren’t completely processed.
  • SolidWorks 3D models inside zip files failed to display.
• A Python SDK Protobuf version mismatch caused an error. The SDK has been refactored to support Protobuf versions lower or equal to version 3.16.0 to fix dependency conflicts with Python packages, such as TensorFlow, Streamlit, and Azure Functions.
• Fixed an error where the Cognite Functions user interface didn’t show data in the Input data field when you listed scheduled functions.