ISLAMABAD, Oct 17 (APP): Huawei’s OceanStor A310 addresses critical industry challenges and expands the horizons of AI as it provides optimal storage capability for basic model training, industry model training, and inference in segmented scenario models, unleashing new AI capabilities.
The launch demonstrates Huawei’s alignment with the latest trends of AI development in the era of large models.
The OceanStor A310 deep learning data lake storage caters to different industries and scenarios in large AI model applications mitigating the most significant challenges enterprises face in the development and implementation of large model applications.
Currently, pre-processing about a hundred terabytes of data takes around ten days as data preparation takes a long time, with dispersed data sources and slow aggregation.
Moreover, for multi-modal large models using massive text and images as training sets, the current loading speed for a large number of small files is less than 100MB/s, resulting in low efficiency in loading training sets. Further delays occur because of the frequent tuning of large model parameters and instability in the training platform leading to training interruptions and recovery processes.
The high threshold for large model implementation, complex system construction, difficult resource scheduling, and GPU resource utilization is usually below 40%.
Meanwhile, the Huawei OceanStor A310’s deep learning data lake storage caters to different industries and scenarios in large model applications.
In the context of basic/industry large model scenarios, OceanStor A310 is a deep learning data lake storage solution that offers unlimited horizontal scalability and high performance for mixed workloads.
It enables end-to-end massive data storage management for AI processes, including data collection, preprocessing, training, and inference. It possesses data analysis capabilities consistent with HPC and big data, allowing for the processing of data from similar sources.
Peter Zhou, President of Data Storage Product Line, Huawei said, “With the OceanStor A310, we are bringing our customers and partners a cutting-edge AI storage solution to unleash new AI capabilities and create value for various industries.
Visitors to our GITEX stand can witness how Huawei is committed to accelerating the intelligent era, leveraging a trusted, secure, and reliable OceanStor platform used by some of the leading businesses in the world.”
مضمون کا ماخذ : راکی
