> ## Documentation Index > Fetch the complete documentation index at: https://docs.cognite.com/llms.txt > Use this file to discover all available pages before exploring further. # What's new in 2023 > Product updates and improvements to Cognite Data Fusion from 2023. Workspace names in this 2023 changelog use labels from that year. **Industrial tools** is now the **Flows** workspace; **Data management** is now the **Data fusion** workspace. ### New and updated features #### Cognite Data Fusion * Use the new [search](/cdf/explore/search) on the CDF home page to find data for your daily tasks. The search results show all connected (contextualized) items to give the full context of your data. You can open the results directly on the **Industrial canvas** or **Charts** for further analysis and collaboration. (*public preview*) You can also find data using [Cognite AI](/cdf/explore/search#search-using-artificial-intelligence) (artificial intelligence) for industrial data. Select the Search using AI tab to try one of the example questions or write your own. (*public preview*) * We've added several features to the [Industrial canvas](/cdf/explore/canvas). Copy content between canvases, duplicate canvases, and select which properties to show on asset cards. (*public preview*) * In **Charts**, create a calculation pipeline by [saving, scheduling, and monitoring calculations](/cdf/explore/charts). (*public preview*) * In the **Data explorer**: * Filter assets, time series, files, events, and sequences by all linked resources, directly linked resources, and relationships. For assets and files, you can also filter by annotations. * Filter by Parent and Child under Assets in the sidebar. * **Jupyter Notebook with AI copilot** is now an integrated part of CDF. Use Cognite AI to write and understand code or explain scripts from others. Notebooks run in a sandboxed environment inside the browser using the current user credentials. You can share notebooks with your coworkers. (*public preview*) * To search for equipment using **3D models**, admin users can manually link objects or areas in CAD models and point cloud models to equipment and update existing links between 3D objects and tags. (*public preview*) * The new [Cognite OPC Classic](/cdf/integration/guides/extraction/opc_classic) extractor reads time series and asset information via the OPC DA and HDA protocols. (*public preview*) * [User profiles](/cdf/access/guides/capabilities#enable-or-disable-user-profiles) are now in [production](/cdf/product_feature_status#production) release status. When activated by a CDF admin, user profiles let users share data and mention their coworkers. * For Model your data, we've made these improvements: * When you open the code editor without being in edit mode, you'll find links to Preview data and Transform data above each data type. * In the Types section: * The Add type button is now located in the header panel. * Search for data types in the Search field. * Select Type or Interface when you add a type. * Each type is labeled with additional info, such as import and read-only directives. * In the GraphQL section, you can use the `@default` directive to set the default value for a property. For instance: `type Pump { weight: Int @default(value: "5") }` #### InField :::info Limited availability The updates and features are currently available to selected customers only. ::: * **[Offline mode](/cdf/infield/guides/perform#work-offline)**. Complete operator rounds and work orders without network connectivity. Open the checklist on your mobile device before performing tasks, and if you go offline, you can still complete your tasks but with limitations. When offline, you can't access the asset explorer, upload media, or create observations. #### InRobot :::info Early adopter The updates and features are currently available to selected customers via the **Early Adopter** program. ::: * **Mission scheduling**. Automate robot missions. Plan single or recurring autonomous robot missions, set the date and time of the mission, or skip one of the scheduled mission runs. * **Gauge details**. View the gauge type and gauge values in the reports. * **Gauge asset metadata**. Edit the gauge asset metadata in reports to improve gauge reading functionality. * **Time series access**. Navigate from Reports to **Data Explorer** to analyze time series. ### Resolved issues and minor updates #### Cognite Data Fusion * In the **Data explorer**, we've resolved these issues: * On the Asset tab: * If you select an asset, you automatically navigate to the same asset when you open the Hierarchy tab. * The asset hierarchy only displayed if the root asset was displayed on the first page of the results. * On the Files tab: * Some files were incorrectly linked to an asset. * If you added multiple tags to an engineering diagram, the Select button would show as deactivated. * On the Details tab: * The Label field now displays the same name as in the source system. * On the **Industrial canvas**, we've resolved these issues: * When you add data to a canvas, the Load more button and the date selector for time series are easier to access. * If you added a rectangle around an engineering diagram, you couldn't interact with the annotations. * Lines didn't display correctly on the engineering diagrams. * In **Charts**, we've resolved these issues: * The chart now previews a threshold line when you configure a monitoring task. * If you monitor time series, the email alerts contain more context for threshold breaches. * In the Create interactive diagrams, we've resolved these issues: * When you selected a set of assets to link to a diagram, some assets were excluded as potential candidates. All selected assets are now considered for linking with the diagram. * When you linked to other engineering diagrams, More filters didn't display all the values correctly. * On the CDF home page, we've resolved these issues: * If you've worked with **Charts** and **Industrial canvas**, these are now added to the Recent activity section. * For Access management, we've resolved these issues: * Some users got an incorrect Access required message when they signed in to CDF. * Access was denied if you closed CDF without signing out and then re-opened CDF with a URL address that included the CDF project. * For Model your data, we've resolved these issues: * If you created a data model using the CDF CLI, it wasn't possible to add a description. * On the Data management tab: * The knowledge graph icon didn't open GraphQL. * The instance count didn't show the correct numbers. * The scroll bar for selecting a relationship when you create a transformation didn't scroll. * The field name would disappear when you added a type. * Reference nodes didn't load correctly. * If you deleted a type from the code editor and switched to the list view, CDF stopped responding. ### Changes to Cognite Functions on Google Cloud Platform From February 1, 2024, the function call timeout will be changed from 15 to 9 minutes for projects running on Google Cloud Platform (GCP). [Learn more](/cdf/functions/technical). ### Deprecated and retired features #### Cognite Data Fusion * Automatic Identification and Reporting (AIR) is deprecated from October 6, 2023, and will be retired from December 31, 2023. The core functionality of AIR has been integrated into **Charts**. * Asset Data Insight (ADI) is deprecated from October 5, 2023, and will be retired from December 31, 2023. **Charts**, **Industrial canvas**, and **Data explorer** are available through fusion.cognite.com to replace the key ADI workflows. See also: [Overview of deprecated and retired features](/cdf/deprecated). ### Cognite API updates To see changes to the Cognite API, visit the [API changelog](/api-reference/changelog). #### Enhancements * Work in your preferred language in InField, Maintain, Charts, Industrial Canvas, and the Data Explorer. Navigate to Manage account on your user profile and select among the languages listed below. This feature is in *public preview*. `Deutsch` - `English` - `Español` - `Français` - `Italiano` - `Nederlands` - `Norsk` - `Português` - `Svenska` - `한국어` - `中文` - `日本語` * Collaborate on the data on a [canvas](/cdf/explore/canvas), for example by entering comments and tagging co-workers. Select Share to give co-workers access to the canvas. This feature is in *public preview*. * You can now use data from your custom CDF data models in **Power BI**, and use [GraphQL mutations](/cdf/dm/dm_graphql/index) to update your data model data. * Use [data point subscriptions](/dev/concepts/data_point_subscriptions) to configure a subscription to listen to changes in one or more time series. A time series may be part of many subscriptions. Use this feature if you need to keep up to date with changes to one or more time series without re-ingesting the entire time series. See also the [API documentation](/api-reference/concepts/20230101/data-point-subscriptions) or try it out using the [Python SDK](https://cognite-sdk-python.readthedocs-hosted.com/en/latest/core_data_model.html#data-point-subscriptions). This feature is in *public preview*. * We're releasing the [Cognite File Extractor](/cdf/integration/guides/extraction/file) into [production](/cdf/product_feature_status#production) release status and upgrading the [Cognite DB Extractor](/cdf/integration/guides/extraction/db) to version 3 with the following enhancements: * Ingest data into the CDF asset and event services by structuring the query to return keywords as column names. You can also write a table to CDF sequences, and if the database contains binary data, you can upload it to CDF files. * Native support for databases, such as **PostgreSQL**, **Snowflake**, **Azure Cosmos DB**, and **MongoDB**, means you can connect to the extractor without using Open Database Connectivity (ODBC) drivers. * Schedule queries with cron expressions or intervals, for example, `6h` or `15m`. Disable scheduling with a global configuration parameter while leaving the `schedule` keyword in the query configuration, for instance, for debugging or manual runs. * Ingest data into CDF using the **MQTT streaming service\~**. Cognite's infrastructure hosts the extractor, and you configure the extractor using CDF to connect to an MQTT broker. You listen to data by subscribing to topic filters and specify the message format for the extractor to ingest data arriving on the configured MQTT topics. This feature is in *public preview*. * In the **Cognite Python SDK**, you can now use advanced search and filtering on metadata across events, time series, asset, and sequences, using the `.filter()` method, for example, `client.events.filter`. * In **Cognite InRobot**, you can: * Pause/resume missions as you navigate the robot or when it performs missions autonomously. * Cancel missions, but pause the mission before you cancel it. * Review old and new images of inspection points on the Actions report. * The robot can return to the dock without the docking station in sight. This feature is in *public preview*. #### Limited availability :::note The features described in this section are currently only available to selected customers. ::: * We're releasing new experiences for **Cognite Maintain** and \[**Cognite InField**]. This includes a new user interface and functionality for both applications to streamline the Cognite asset performance management offering. * Create a calculation pipeline in [Charts](/cdf/explore/charts) by scheduling and monitoring calculations. Use the option Save and schedule to set the run intervals. Set up monitoring of time series and calculations together. If a threshold is breached, subscribers will receive an email notification. *public preview*. #### Deprecated features * Starting September 1, 2023, we'll no longer develop new features for **Cognite Remote**. See [Deprecated and retired features](/cdf/deprecated) for more information. #### Resolved issues * For **data transformations**, we've resolved issue where long-running transformations timed out due to driver restart errors. * For the **Cognite extractors**, we've resolved an issue where some users experienced timeouts when running the Cognite DB Extractor. Note that the recommended size of the upload queue is 50 000 rows and that the `query` parameter should contain a `where` clause using the substitutions `{incremental-field}` and `{start-at}` if data is loaded incrementally. * In the **CDF data modeling** framework, we've resolved these issues: * Some users got inconsistent results when listing data models using the CDF UI and the CDF API. * It wasn't possible to populate two or more views pointing to the same node using transformations. * CDF CLI, v2.3.0: The data model name and description were deleted when you published the data model. * In the **Data Explorer**, we've resolved these issues: * If you searched for a file from the CDF home page, you were directed to the file search in the **Data Explorer**. Now, the file opens directly. * Changes weren't kept when you created tags manually on an engineering diagram and selected an asset before you saved. * It wasn't possible to filter by relationship on the Files tab using the tree view. * Some customers were not able to search in the **Data Explorer**. * The filtering of resource labels didn't limit the labels according to the filtering. * The file number count for a document category and linked files weren't aligned. * The linked asset count on the File tab in the Data Explorer and the count from the Cognite SDKs weren't aligned. #### Enhancements * When you open the CDF portal application, you'll find a new home page with direct access to popular features. Select a card to open a feature or select **View all** to see all features. * Enhancements to the **CDF data modeling** framework include: * Use the **Browse library** feature to select predefined data models you can tailor to your industry standards. * [Display time series data from CDF data models](/cdf/dashboards/guides/grafana/timeseries#display-time-series-data-from-data-model-instances) in the Grafana connector. * [Enable user profiles](/cdf/access/guides/capabilities#enable-or-disable-user-profiles) to let users share data and @mention other users. * Extract data from SAP with the new [Cognite SAP extractor](/cdf/integration/guides/extraction/sap). * Fine-tune the results in the **Data explorer** with dynamic filtering for units and metadata values. * Specify a data set when you upload files or functions to CDF and filter on data sets on the **Files** tab in the **Data explorer**. #### Enhancements to features in Beta testing :::caution Beta The features described in this section are in [public preview](/cdf/product_feature_status#public-preview) and may change. ::: * We've released a beta version of the [Cognite Industrial canvas](/cdf/explore/canvas) where you can access all data, such as documents, engineering diagrams, sensor data, images, and 3D models, on a canvas. #### Product release spotlight Visit the Cognite Hub to watch the [product release spotlight video](https://hub.cognite.com/product-updates/product-release-spotlight-june-2023-release-cognite-data-fusion-1855). #### Resolved issues * In the **CDF data modeling** framework, we've resolved these issues: * The **Data management** page treated fields that started with `=` as an expression. * Some users received a *5xx error* code when they created or updated data models. * Some users received a *4xx error* code when they loaded the **Data management** page or retrieved data from the GraphQL explorer. * For **3D models**, we've resolved these issues: * We've improved the performance when you browse, navigate, and retrieve information in 3D models. * We've fixed an issue where contextualized assets weren't highlighted if you opened a 3D model from the **Data explorer**. * For **data transformations**, we've resolved these issues: * When you selected **Profile** to view staged data, you couldn't sort functions in columns. * CDF defined the `split_part` Spark function as an undefined function. * In the **Data explorer**, we've resolved these issues: * If you applied a filter to your data, the remaining filters didn't update. * Some files were available in data sets but not in the **Data explorer**. * We've fixed an issue where some users received a *4xx error* code when they created a group in **CDF Access management**. * We've fixed an issue where some users experienced that files were deleted from their CDF project. We've improved the logs to track the delete history. * We've fixed an issue where a `Failure Exception: CogniteDuplicate` error occurred when creating or updating time series. #### Enhancements * We're releasing the advanced [CDF data modeling framework](/cdf/dm/index) into [production](/cdf/product_feature_status#production) release status.
Data models are the core of understanding relationships between data objects and establishing data products for data science models, mobile apps, and web apps. You can now express data according to your best practice or industry requirements, such as source system models, solution-specific models, or domain data models. Version the models to test, iterate, and reuse them to scale with the underlying data. You can model data using the [CDF portal application](/cdf/dm/index) and review and explore the data with the built-in query explorer. * We now group 360-degree images from similar locations in 3D views and dim all image indicators behind geometry in point clouds or CAD models. * Use the search parameter option next to the search bar to fine-tune your search in the **Data explorer**. * Open selected time series directly in **Charts** with the **Charts preview** button in the **Data explorer**. * When you create interactive engineering diagrams, we now recognize bundled tag names, for instance, Tag A/B, as separate tags. * You can now use a key/certificate pair to authenticate the CDF extractors to Azure AD. * 3D models visualize textured surfaces, and the Cognite Reveal 3D SDK now supports textured 3D models. #### Enhancements to features in Beta testing :::caution Beta The features described in this section are currently in Beta testing and are subject to change. **don't** use the features in production systems. ::: * In **Charts**, you can define upper or lower threshold values for time series and receive an email if the thresholds are breached. * The Cognite InRobot beta version has been updated. #### Resolved issues * In **Data transformations** we've resolved these issues: * The transformations preview didn't display data points with negative timestamps. * Transformations failed due to many `WHEN` statements in the SQL query. * Scheduled transformations failing due to service downtimes. * In **Data search** we've resolved these issues: * A bug in the asset hierarchy request to CDF caused an incorrect asset sub-tree hierarchy. * Some file types were incorrectly sorted as *Other* on the **Files** tab. * If you uploaded a .zip file to **Cognite Functions**, the file name extension changed to .txt when you downloaded the file from the **Data explorer**. * Deleted files appeared to be available for download from the **Files API** and the **Data explorer**. * Some users received a *5xx server error* response code when they updated large amounts of assets using the CDF Assets API or the Cognite Python SDK. * Time series matched with assets displayed as unmatched in the result preview in **Entity matching**. * A blank canvas appeared when you searched on the **Data** tab in the **Data catalog** and if you created a new extraction pipeline without the `extractionpipelines:read` access capability. * .svg files did not display in **Charts**. * Improved wording in the error message that appears if you sign into a CDF without a project name using the Cognite Java SDK. * When you created a CDF project, the access capability `project:list` wasn't included in the initial setup of a CDF project and prevented access to the **Access management** page. * The processing status on the **Revision details** section for 3D models incorrectly reported *no logs* even when logs existed. See also the [Cognite SDKs](/dev/sdks) and [CDF API](/api-reference/changelog) changelogs. #### Enhancements * Transform data with a new interface in [CDF Transformations](/cdf/integration/guides/transformation/transformations). * You'll find a new no-code mapping option for source-to-target fields. Map the fields manually or use CDF's suggestions. * The Spark SQL editor offers built-in code completion, built-in Spark SQL functions, and built-in Cognite custom SQL functions. * Discover gaps and deviations in time series with the new [Data profiling](/cdf/explore/charts) side panel in **Charts**. * View 360-degree images, either in isolation or in the context of point cloud, CAD, and BIM models in the **Data explorer**. * Preview documents such as text files, JSON files, spreadsheets, documents, and slides in the **Data explorer**. * Ingest data from files in JSON format to the [CDF staging area (RAW)](/cdf/integration/guides/extraction/raw_explorer). * The [Annotations API](/api-reference/concepts/20230101/annotations) is now used as the storage mechanism for annotations in file viewers. Existing annotations have been migrated from the Events API. * We've released Cognite InField versions 11.0 and 11.1 with improvements to the InField 3D model and checklists. #### Enhancements to features in Beta testing :::caution Beta The features described in this section are currently in Beta testing and are subject to change. We recommend that you **don't** use the features in production systems. ::: * Enhancements to the new **data modeling** feature include: * Transform data into and between data models using the new **CDF Transformation** user interface. * Improved architecture for reusing data across data models. * Advanced data modeling with inheritance and composition. * Versioning of data models and data model types to enable no re-ingestion of data across versions for common properties. * Enhancements to the **Data explorer** include: * Filter data using multiple values. * View connected engineering diagrams side-by-side by selecting links in a diagram. * Extract well data from the Open Group OSDU Data Platform with the new [Cognite OSDU extractor](/cdf/integration/guides/extraction/osdu). You can extract data using the OSDU generic API and the Wellbore DDMS. The extractor is compatible with Microsoft Energy Data Services. * Extract documents with the [Cognite File Extractor](/cdf/integration/guides/extraction/file). You can extract files from local file systems, network sharing protocols such as FTP, FTPs, and SFTP, SharePoint Online Document libraries, Google Cloud Storage, and Azure Blob Storage. * We've released a Beta version of Cognite InRobot. This new application works in sync with a robot to collect and automate data collection and inspection. :::tip You'll find Early adapter programs and discussion groups for these features on the [Cognite Hub](https://hub.cognite.com). ::: #### Resolved issues * **Cognite PI extractor** error on Windows Server 2012 R2. Note that this extractor requires .Net Framework 4.8 or higher. * The **Data set** list in the Quick match option in **Match entities** didn't list all data sets. * **Charts** would not load and displayed the error message *Failed to load firebase error*. Make sure to open **Charts** from within CDF. * Fixed an error where scheduled transformations were deleted due to an error in the token session refresh. * Resolved issues in the **Data explorer** include: * The filter on the **File** tab was case-sensitive. Now, you can enter filter criteria with all cases. * If you selected an asset in the list view on the **Asset** tab, then changed to the asset hierarchy view, the selected asset lost focus. * Resolved issues in **3D models** and **Reveal** include: * Large models with metadata weren't completely processed. * SolidWorks 3D models inside zip files failed to display. * A Python SDK Protobuf version mismatch caused an error. The SDK has been refactored to support Protobuf versions lower or equal to version 3.16.0 to fix dependency conflicts with Python packages, such as TensorFlow, Streamlit, and Azure Functions. * Fixed an error where the Cognite Functions user interface didn't show data in the **Input data** field when you listed scheduled functions. ## Other releases * [Current updates](/cdf/whatsnew) * [2024 updates](/cdf/whatsnew/2024) * [2022 updates](/cdf/whatsnew/2022) * [2021 updates](/cdf/whatsnew/2021)