Hewlett Packard Enterprise today announced the launch of HPE Swarm Learning, a breakthrough AI solution to accelerate insights at the edge, from diagnosing diseases to detecting credit card fraud, by sharing and unifying AI model learnings without compromising data privacy.
HPE Swarm Learning, which was developed by Hewlett Packard Labs, HPE’s R&D organization, is the industry’s first privacy-preserving, decentralized machine learning framework for the edge or distributed sites. The solution provides customers with containers that are easily integrated with AI models using the HPE swarm API. Users can then immediately share AI model learnings within their organization and outside with industry peers to improve training, without sharing actual data.
Introducing a new AI approach to securely harness insights at the edge
Today, the majority of AI model training occurs at a central location, which relies on centralized merged datasets. However, this approach can be inefficient and costly due to having to move large volumes of data back to the same source. It can also be constrained by data privacy and data ownership rules and regulations that limit data sharing and movement, which can potentially lead to inaccurate and biased models. By training models and harnessing insights at the edge, businesses can make decisions faster, at the point of impact, leading to better experiences and outcomes. Additionally, by sharing learnings from one organization to another at the data source, various industries across the world can unite and further improve intelligence that can lead to tremendous business and societal outcomes.
However, sharing data externally may raise a challenge for organizations that are required to meet data governance, regulatory or compliance requirements, mandating that data stay at its location. HPE Swarm Learning uniquely enables organizations to use distributed data at its source, which increases the dataset size of for training, to build machine learning models to learn in an equitable way, while preserving data governance and privacy. To ensure that only learnings captured from the edge are shared, and not the data itself, HPE Swarm Learning uses blockchain technology to securely onboard members, dynamically elect a leader, and merge model parameters to provide resilience and security to the swarm network. Additionally, by only sharing the learnings, HPE Swarm Learning allows users to leverage large training datasets, without compromising privacy, and helps remove biases to increase accuracy in models.
“Swarmifying” data to empower AI for the greater good
HPE Swarm Learning can help a range of organizations to collaborate and improve insights:
• Hospitals can derive learnings from imaging records, CT and MRI scans, and gene expression data to be shared from one hospital to another to improve diagnostics of diseases and other ailments, while protecting patient information.
• Banking and financial services can fight the expected global loss of more than $400 billion in credit card fraud over the next decade2, by sharing fraud-related learnings with more than one financial institution at a time.
• Manufacturing sites can benefit from predictive maintenance to gain insight into equipment repairing needs and address them before they fail and cause unwanted downtime. By leveraging swarm learning, maintenance managers can gain better insight by collecting learnings from sensor data across multiple manufacturing sites.
Availability
HPE Swarm Learning is available now in most countries.
HPE delivers a complete, ready-to-use machine learning development solution
HPE also announced today that it is removing barriers for enterprises to easily build and train machine learning models at scale, to realize value faster, with the new HPE Machine Learning Development System. The new system, which is purpose-built for AI, is an end-to-end solution that integrates a machine learning software platform, compute, accelerators, and networking to develop and train more accurate AI models faster, and at scale.
