New Snowflake Features Released in May-July 2022

It’s been a busy summer for Snowflake. We announced a wave of new features and capabilities at our Snowflake Summit Sessions—which drew close to 10,000 in-person attendees and over 200 partners. Read the capsule summaries below and review the Summit recordings for more details on these announcements.

Grow Your Business in the Data Cloud

Listing Usage Metrics and Analytics 

Provider Studio analytics allows providers to track the usage of their Snowflake Marketplace or privately shared listings (in Private Preview) including active consumers, views, requests, database mounts, and query runs. These analytics give providers visibility into how their products are used by both prospective and existing consumers, allowing for better evaluation support and improving their listed products. 

In Private Preview, we now offer aggregated usage analytics that provide insight into listing reach and engagement to improve and optimize your business performance in the Marketplace. Request to become a Snowflake Marketplace Provider or explore your analytics insights today.

New Schema for Listing Usage Metrics and Analytics

In addition to the analytics available in Snowflake’s Provider Studio, providers can run advanced analytics via SQL using the DATA_SHARING_USAGE schema. This includes views that display information about listings published in the Snowflake Marketplace or that are privately shared (via Private Preview). It also covers telemetry data (number of clicks), as well as consumption data (queries run by consumers). Reference our documentation for more details.

Monetization in the Data Cloud

Providers can publish paid listings to the Snowflake Marketplace as well as share listings privately (in Private Preview) with other accounts that they designate. This capability opens the door for providers to monetize standardized products to self-service buyers in 33 countries—opening the door to new markets and streamlining sales processes. Providers can also choose from flexible usage-based pricing options where Snowflake takes care of the metering and billing on your behalf. Learn more about paid listings or how to become a Snowflake Marketplace Provider.

Snowflake Marketplace Provider Resources

The Provider Studio includes a “Learn” tab that offers a variety of information about getting started as a Snowflake Marketplace Provider. Providers can access onboarding materials, view examples and best practices, and get familiar with Snowflake Marketplace terms of service and policies. Explore all the benefits by enrolling in the Snowflake Partner Network. 

Self-Service Onboarding to the Snowflake Marketplace

Providers can quickly onboard themselves to the Snowflake Marketplace. Start creating new Provider Studio listings by accepting Snowflake Marketplace terms and conditions, updating your billing information, and creating a profile to promote your offerings in the Data Cloud. Become a Snowflake Marketplace Provider today!

Drive Business Insights with the Snowflake Marketplace

Discovering Relevant Listings on the Snowflake Marketplace 

We’ve made it even easier for Snowflake Marketplace users to find the most relevant listings when browsing. The Marketplace gallery page features a “Most Popular Listings” section—in addition to search results and category views presenting the most popular listings at the top. 

Another key addition is that users can change the default filter setting to browse all Marketplace listings—regardless of availability in their specific cloud region. Listings include details about cloud region availability while highlighting the region where the user’s account is located. This new option provides full visibility of Marketplace offerings to users, as well as the ability to contact Marketplace providers to request a specific listing for your region. Explore the Snowflake Marketplace to drive business insights from the world’s best providers in an instant.

Data Programmability

Snowpark API for Java, Scala, and Java UDFs—Now Generally Available

Snowpark is a developer experience that brings deeply integrated, DataFrame-style programming to the languages developers like to use. Snowpark API for Java is generally available on AWS, and Snowpark API for Scala and Java UDFs are generally available on Azure. Snowpark is designed to make building complex data pipelines a breeze and allow developers to interact with Snowflake using their preferred language directly without moving data.. Get more details about these capabilities.

Snowpark for Python—Now Available to All

Python developers can enjoy the same ease of use, performance, and security benefits of other broadly available languages supported through Snowpark. This release includes the public preview of Snowpark for Python API, Python User Defined Functions (UDFs) and User Defined Table Functions (UDTFs), Stored Procedures, and Batch API (Vectorized UDFs). Visit the announcement blog to learn more about each of these features and access hands-on content to help you get started.

Data Pipelines

Improved Pipeline Experiences

Snowflake is working on a set of features to make data engineering easier and more productive for day-to-day tasks. With this release, we are pleased to announce a preview of Snowpipe error notifications for Google Cloud and Microsoft Azure. Error notifications can be pushed to either the Google Cloud Platform Pub/Sub or Microsoft Azure Event Grid cloud messaging service. When Snowpipe encounters errors while loading data from files staged in any supported cloud storage service, this feature triggers a notification that describes the errors, enabling further analysis of the data in the files. In addition, task error notifications can send a description via cloud messaging when encountering errors during a run. It enables further analysis of the SQL code in the task definition. These recent innovations—and many more—are detailed in our Snowflake Summit Sessions.

Execute Easily with Tasks DAG Support

Data engineering executes transformations more easily with the public preview of Directed Acyclic Graph (DAG) support for tasks. A DAG is a series of tasks composed of a single root task and additional tasks organized by their dependencies. Previously, users were limited to task trees, in which each task had, at most, a single predecessor (parent) task. In a DAG, each non-root task can have dependencies on multiple predecessor tasks, as well as multiple subsequent (child) tasks that depend on it. Explore our Summit Sessions to learn more about Snowflake DAG support.

Migrations

Snowflake Scripting is Now Generally Available

Snowflake Scripting is now generally available, allowing you to create scripts and stored procedures in SQL with Snowflake. This procedural language extends the SQL language with structures and control statements, such as conditionals and loops. This also makes it easy for Snowflake users (many of whom know and love SQL) to create stored procedures and translate existing SQL-based scripts. During the preview, we saw incredible adoption and usage of this feature—it’s easy to get started. Learn what you need to know.

Core Engine Performance Advancements

Query Acceleration Service: Scale Out Compute for Queries Without Resizing Virtual Warehouse

Snowflake’s Query Acceleration Service is in public preview for Enterprise and higher editions—enabling more flexibility for balancing cost and performance. Whereas multi-cluster virtual warehouses allow horizontal scaling to handle more concurrency, our Query Acceleration Service enables vertical scaling to accelerate queries. With the same virtual warehouse size, you can scale to additional compute nodes. Read about this and other recent core engine innovations.

Transparent Performance Optimizations for Interactive Use Cases

A high degree of concurrency has been a critical component of our scalable platform and we’re happy to announce a number of new improvements. You can now perform write-heavy Data Manipulation Language (DML) workloads significantly faster. Snowflake users who have been running hundreds of DML operations per second saw a 10% reduction in latency on average; some of them saw as much as a 40% reduction.

Last year, we announced that Snowflake can power interactive dashboards and embedded analytic use cases. This was the result of the team making precise improvements: reducing latency and improving concurrent select query processing. That was just the beginning. We’ve continued to find new areas to improve and further reduce the latency of very short 100ms queries by another 10%. Learn more in our platform and engine announcements.

Governance

Snowflake Native Data Classification—Generally Available on AWS and Azure (GCP coming soon)

We are excited to announce that Snowflake’s native Data Classification is now generally available on AWS and Azure, and soon, on Google Cloud. We have made a number of performance and accuracy improvements with the deployment of a new model, and we added support to classify simple variant columns and output the result of all columns. Organizations that hold personal information must make sure it is properly governed to meet compliance requirements and mitigate risks. But first, they need to classify information as “personal” to know where that personal information resides in their Snowflake account. Once they know where it is, they can track it with System Tags, audit who has access to it, and put in place policies to ensure it is only accessible to those who require access. Learn more about our latest classification capabilities.

Snowflake’s Native Tag-Based Masking Policy in Public Preview

Our policy for native tag-based masking is available in public preview. A tag-based masking policy combines object tagging and masking policy features to allow a masking policy to be set on a tag. This simplifies data protection efforts because column data that should be protected no longer needs a masking policy manually applied to the column to protect the data. Get more details about Snowflake tag-based masking.

Cross-Cloud Continuity 

Account Replication and Failover for Turnkey Continuity

Snowflake Account Replication and Failover capabilities are also available in public preview. Account Replication expands replication beyond databases to include account metadata and integrations, making business continuity truly turnkey. Paired with the upcoming Client Redirect feature (generally available soon), users will be able to recover their account and client connections in seconds at virtually any scale. For even higher resiliency, these features can be used to perform failover across public clouds. Learn more about these new features and Snowflake’s cross-continuity capabilities.

Global Expansion

New Regions Available on AWS, Azure, and Google Cloud 

Snowflake’s global availability has expanded to include Central India (Pune) on Azure, South America (São Paulo) and Asia Pacific (Osaka) on AWS, and U.S. East 4 (N. Virginia) on Google Cloud. With these additions, Snowflake supports 35 global regions across three cloud platforms (AWS, Azure, and GCP), including three regions for compliance with U.S. government regulations. Check out our full list of supported regions. 

Snowflake Marketplace

Snowflake customers can tap into Snowflake Marketplace for access to more than 1,300 live and ready-to-query data, data services, and applications from over 260 third-party data providers and data service providers (as of April 30, 2022), as well as market their own products across the Snowflake Data Cloud. Visit Snowflake Marketplace.

RECENTLY ADDED SNOWFLAKE MARKETPLACE PROVIDERS

COMMERCE

AMP Memberships

Car wash mobile app and customer experience platform. Learn more.

FINANCIAL

Flipside Crypto

Flipside enables on-demand analytics for blockchains, driving ecosystem growth and retention. Through a free, open-data platform, thousands of analysts can learn, collaborate, and compete to solve analytical challenges via structured bounty programs. Learn more.

CRED iQ

CRE Data, Analytics, and Valuation

Search over $2 Trillion of Commercial Real Estate

*Managed by Foodtruck.ai* 

Learn more.

Quick Corp

As a financial information provider in the Nikkei Group, QUICK distributes real-time global securities and financial information as well as political news and economic information. Learn more. 

MEDIA

Podchaser

Podcast Reach, Audience Demographics, Sponsor Data & Contacts at Your Fingertips

The only one-stop shop for ALL podcast data and contacts. Learn more.

TRAVEL

Skyscanner

Skyscanner started in 2003 as a simple way to compare flight prices. Now, we’re a global company, proud to work side by side with the biggest names in travel; 100 million travelers rely on us each month, and we’re proud to be the most trusted travel search site in the world.

With Skyscanner, you can get worldwide traveler data—from one trusted source. Join the leading travel search engine in Europe, Asia-Pacific and the Americas, and you’ll have access to the largest coverage available with an unbiased outlook on global travel trends. Learn more.

TRANSPORTATION

AHEAD

AHEAD builds platforms for digital business. By weaving together cloud infrastructure, intelligent operations, and modern applications, we help enterprises deliver on the promise of digital transformation. Learn more.

LOCAL

DOORDA

Doorda provides business-ready, trusted data on-demand so that organizations don’t have to source and prepare the data themselves. Learn more. 

HEALTH & LIFE SCIENCES

Arcadia

For the past 20 years, Arcadia has been dedicated to making a difference in healthcare through data. Rooted in value-based care and population health management, we have built our expertise across all types of healthcare data including EHR systems, internal and external labs, medical and Rx claims, ADT, and more. Learn more.

—–

​​Forward-Looking Statements

This post contains express and implied forwarding-looking statements, including statements regarding (i) Snowflake’s business strategy, (ii) Snowflake’s products, services, and technology offerings, including those that are under development or not generally available, (iii) market growth, trends, and competitive considerations, and (iv) the integration, interoperability, and availability of Snowflake’s products with and on third-party platforms. These forward-looking statements are subject to a number of risks, uncertainties and assumptions, including those described under the heading “Risk Factors” and elsewhere in the Quarterly Reports on Form 10-Q and Annual Reports of Form 10-K that Snowflake files with the Securities and Exchange Commission. In light of these risks, uncertainties, and assumptions, actual results could differ materially and adversely from those anticipated or implied in the forward-looking statements. As a result, you should not rely on any forwarding-looking statements as predictions of future events. 

© 2022 Snowflake Inc. All rights reserved. Snowflake, the Snowflake logo, and all other Snowflake product, feature and service names mentioned herein are registered trademarks or trademarks of Snowflake Inc. in the United States and other countries. All other brand names or logos mentioned or used herein are for identification purposes only and may be the trademarks of their respective holder(s). Snowflake may not be associated with, or be sponsored or endorsed by, any such holder(s).

Source

Originally posted on September 1, 2022 @ 2:38 am