What's new in CDF?

At Cognite, we are building awesome products. This page is your one-stop-shop for major updates and announcements related to Cognite Data Fusion (CDF).

To stay up to date on all the ongoing improvements we're making to CDF, check out our Cognite Data Fusion and API changelogs too.

Announcements:

New URL and contextualization tools

We are excited to announce fusion.cognite.com as the new URL to access Cognite Data Fusion (CDF) in the cloud.

With the new URL we introduce a refined user experience and also new tools to produce contextualized and discoverable industrial data.

Read more about the new contextualization tools in our blog post or jump straight to the documentation to learn how to match entities and create interactive P&IDs.

Cognite PI Extractor v2.1

The Cognite PI Extractor v2.1 is out of beta and is now available for download from Cognite Data Fusion along with updated documentation.

The Cognite PI Extractor connects to the PI Data Archive, detects and extracts time series data, and transfers the data to your Cognite Data Fusion (CDF) project to make time series available in near real-time.

Learn more about the fixes, improvements, and new features in the changelog.

Product updates: July, 2020

The Cognite Power BI Connector

New function: Time series aggregates

The time series aggregation now accepts a list of IDs instead of a comma separated string. You can now use a column from another query directly as input to the function, making it much easier to use.

Setting the CDF environment for a custom cluster

If a CDF project is on a custom cluster, you can set the CDF Environment to the URL of the API server for the cluster when you connect to CDF.

You can also set a specific API version by appending it to the URL, for example v1. We also support shorthand notations. For example, api/v1 uses the default API endpoint and v1 of the API.

Examples of supported CDF environment values:

  • (blank) - uses the default setting (https://api.cognitedata.com)
  • api - the same as https://api.cognitedata.com
  • api/v1 - the same as https://api.cognitedata.com/v1
  • https://api.cognitedata.com
  • https://api.cognitedata.com/v1
  • xyz - a custom cluster. The same as https://xyz.cognitedata.com
  • xyz/v1
  • https://xyz.cognitedata.com
  • https://xyz.cognitedata.com/v1

Learn more about the Cognite Power BI connector.

New SDK section in the developer portal

The new section gathers the most useful resources and links related to the CDF SDKs:

  • Getting started with JavaScript SDK and Python SDK.
  • Quick links to reference documentation and GitHub repositories.
  • Additional guides such as authentication, upgrade guides for JavaScript SDKs.
  • Release notes for SDKs are now part of the developer portal.

Python SDK 2.1

The new release introduces an improved interface to make it easier to work with labels.

# create label definition(s)
client.labels.create(LabelDefinition(
    external_id="PUMP",
    name="Pump",
    description="Pump equipment"))
# ... or multiple
client.labels.create([
    LabelDefinition(external_id="PUMP"),
    LabelDefinition(external_id="VALVE")])
# list label definitions
label_definitions = client.labels.list(name="Pump")
# delete label definitions
client.labels.delete("PUMP")
# ... or multiple
client.labels.delete(["PUMP", "VALVE"])
# create an asset with label
asset = Asset(name="my_pump", labels=[Label(external_id="PUMP")])
client.assets.create(assets)
# filter assets by labels
my_label_filter = LabelFilter(contains_all=["PUMP", "VERIFIED"])
asset_list = client.assets.list(labels=my_label_filter)
# attach/detach labels to/from assets
my_update = AssetUpdate(id=1)
    .labels.add(["PUMP"])
    .labels.remove(["VALVE"])
res = c.assets.update(my_update)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32

To learn more about the changes in new release, see the release notes.

JavaScript SDK 3.0

New major release separates SDK into 3 different packages:

  • A core package that contains the SDKs infrastructure. This is used by the other packages and allows users to easily create their own SDK by just defining the interface.
  • The stable package contains all the stable API endpoints.
  • The beta package extends the stable SDK with beta API functionality.

In addition to structural changes, the new version of the SDK introduces these changes:

  • unit attribute is now exposed in data points objects.
  • Fields that can have arbitrary string names (Raw, Metadata) are no longer converted to Date objects if their names are: createdTime, lastUpdatedTime, uploadedTime, deletedTime, timestamp, sourceCreatedTime or sourceModifiedTime.

To learn more about the new release, see the release notes.

TIP

To upgrade to the newest version, follow the migration guidelines.

Resources

Find up-to-date release information for tools and libraries here:

Product updates: June, 2020

June has been an exciting month in Cognite with several large improvements and quality-of-life enhancements.

New and improved Cognite Data Source for Grafana

Grafana is a flexible and powerful dashboarding tool, where anyone can easily create any desired dashboard for real-time data.

We’re launching a new Cognite Data Source for Grafana that runs on our API v1, so that you can take advantage of all the latest product features in your dashboards. Read more about the latest changes in our blog post or jump straight to the documentation to learn how to create awesome dashboards on Fusion.

Synthetic time series

As a developer, you know that end users typically care about combinations of different time series. We’re now releasing synthetic time series, so that you can let Cognite Data Fusion handle some of the time series wrangling for you and easily combine time series data, constants, and operators to produce the data that you need. Learn more in our documentation.

Explore data using domain terms

We've made it even easier for data consumers to work with data, by letting you explore data using your familiar domain language. IT and data engineers provide this improved experience for data consumers by defining, managing, and applying labels to data. Learn more in our blog post.

Additional quality-of-life enhancements

Check which types and subtypes of events are available, and how many events you have of each type, in a simple API call. See our event aggregation section in the API docs.

Extending support for CDF API 0.5

We are extending support for API 0.5 until 30th September 2020, in order to provide dashboard creators using Cognite Data Source for Grafana (1.x) with additional time to upgrade to the new version of the connector.

Up-to-date information about supported versions and deprecations is available at API versioning.

Tech Updates video - May

Make sure that you subscribe to our Cognite Tech Updates channel on YouTube for three-minute updates on the latest and greatest tech news from Cognite every month.

Product updates: May, 2020

May 20, 2020

Updated design for the CDF application

We have updated the CDF application to use components from our latest design system.

Insight and Infield use the same components, and this is another step towards making your experience more consistent across all Cognite products.

Tech Updates video - April

Make sure that you subscribe to our Cognite Tech Updates channel on YouTube for three-minute updates on the latest and greatest tech news from Cognite every month.

Product updates: April, 2020

April 24 , 2020

New rule for evaluating time series data

In the Time series quality monitor, you can now use a standard deviation measurement to evaluate if a time series is flatlining.

Time series flatlining

Navigate to fusion.cognite.com to try the new rule.

April 20, 2020

New navigation in the CDF application

The new navigation in the CDF application is our first step towards integrating our core applications into one unified product.

The navigation is more flexible and scalable:

  • Increased discoverability and improved categorization of existing features.
  • More room for future features.
  • More space for information about each feature.

Old and new navigation

Navigate to fusion.cognite.com to see the new navigation in action.

Tech Updates video - March

Make sure that you subscribe to our Cognite Tech Updates channel on YouTube for three-minute updates on the latest and greatest tech news from Cognite every month.

Product updates: March, 2020

April 6 , 2020

Data sets available in Cognite Console

Data sets let you document and track data lineage, ensure data integrity, and allow 3rd parties to write their insights securely back to your Cognite Data Fusion (CDF) project.

Data sets group and track data by its source. For example, a data set can contain all work orders originating from SAP, or the output data from a 3rd party partner's machine learning model. Typically, organizations have one data set for each of its data ingestion pipelines in CDF.

To get started with data sets:

  1. Check out our in-depth article to learn more.
  2. Navigate to fusion.cognite.com, select Data sets, and follow the steps in our guide to create your first data set.

Cognite's Power BI Connector certified by Microsoft

We're excited to announce that Microsoft has certified the Cognite Power BI Connector and that the connector is now publicly available. The Cognite Power BI Connector enables data consumers to easily read, analyze, and present data from Cognite Data Fusion (CDF) in compelling visualizations in both Power BI Desktop and the Power BI service.

You can find the connector in the Other category of the Get Data dialog in Power BI. Learn more in our in-depth article.

New upcoming transformation capabilities

We're continuing our work to improve the asset hierarchy functionality in SQL Transformations. You will soon be able to ingest multiple asset hierarchies at the same time and also ingest asset sub-trees to any level of the hierarchy. The asset hierarchies and sub-trees will merge perfectly with your existing or newly built asset hierarchy.

To give you a more precise and manageable overview of your jobs, we are also updating the UI with additional details about each job: status, time of schedule, last run, duration, and the option to resume or stop a schedule.

Product updates: January – February, 2020

March 2, 2020

Tech Updates video - February

Make sure that you subscribe to our Cognite Tech Updates channel on YouTube for three-minute updates on the latest and greatest tech news from Cognite every month.

Menu

Transform data in Cognite Console

We're pleased to announce that SQL transformations (formerly known as Jetfire) are now available as an integrated part of Cognite Console.

Directly from your browser, you can use Spark SQL queries to transform data from the CDF staging area, RAW, into the CDF data model where the data can be queried by users and applications.

LEARN MORE >

Coming soon - next level data sets!

Many of you love the current data sets feature in the Cognite Console that lets you manually document metadata for your data sources. Now, we are taking data sets to the next level and making data sets a full-stack integrated solution.

You will be able to explore data by source, document and track data lineage, ensure data integrity, and allow 3rd parties to securely write back their insights to your Cognite Data Fusion (CDF) project.

Data sets group and track data by its source. For example, a data set can contain all work orders originating from SAP.

Data set example

Last Updated: 9/16/2020, 10:26:17 AM