December 17, 2021 – The HDF Group, a nonprofit organization whose mission is to advance open source data management technologies, announced the general availability of HDF5 1.13.0, an experimental version of its software library of high performance data. The following is an excerpt from an HDF Group blog post.
HDF5 version 1.13.0 and experimental versions
Last week we released HDF5 1.13.0, our first experimental release. You might be wondering what an Experimental version means for the community.
We are excited to announce a new HDF5 feature delivery strategy: Experimental versions. Experimental builds allow us to put major new features in the hands of our users so that they can test the features and provide feedback before incorporating them into a later maintenance release. Our first experimental release, HDF5 version 1.13.0, is now available and supports VOL connectors, a GPU direct I / O driver, and data access in Distributed Asynchronous Object Storage (DAOS).
Going forward, our release schedule will include both experimental and maintenance versions. According to this new approach, odd minor versions (e.g. HDF5 1.13.x) will be considered experimental, while even minor versions (e.g. HDF5 1.10.x, 1.12.x, 1.14.x) are maintenance releases as you know them now.
Experimental builds allow us to test new features with our users and get feedback as we work on the development of the next major maintenance release. These experimental versions may include substantial updates, such as changes to the file format, API signatures, or public header files. All experimental versions of HDF5 will go through the usual rigorous testing and release process, including generating binaries. All functionalities will be complete, tested, stable and integrated into our development branch. Unlike maintenance releases, binary compatibility should not be expected in a series of experimental releases (eg HDF5 1.13.1 is unlikely to be binary compatible with HDF5 1.13.0). Although rare, users may also experience front / rear file format incompatibility when using new features.
Our future experimental versions are:
- HDF5 1.13.1 (expected release date mid-2022): Includes new ‘VFD SWMR’ feature which will extend single write / multiple drive I / O model support to all HDF5 API calls ( not just dataset I / O, as in the current SWMR implementation) and improved parallel compression functionality that addresses known bugs and scalability issues.
- HDF5 1.13.2: Includes the select I / O function which forwards complete I / O requests to the VFD layer, the “sub-archiving” functionality, which distributes the I / O over a set of sub – HDF5 parallel I / O files and hubs, and the “onion” VFD, which allows users to track changes to an HDF5 file and access previous reports.
Our next maintenance release, HDF5 1.14.0, launches a new series of maintenance releases. Its release is slated for late 2022 and will contain all of the major features listed above. At this time, we would like to drop support for 1.8, 1.10, and 1.12. series.
To make HDF5 1.14.0 the best for our users, we would appreciate your feedback (both positive and negative) on the HDF5 1.13.x versions and how they work for your application. Please send your comments to [email protected]
Remember to log into Call the Doctor to get free HDF5 help every Tuesday
Every Tuesday at 1:00 p.m. CST, The HDF Group hosts Call the Doctor, a session to answer attendees’ questions and, time permitting, provide helpful tips and tricks for using HDF5 or review HDF forum posts from the previous week.
HDF Clinics are free sessions meant to help users solve real-world HDF issues, from the common cold to severe headaches, and provide relief where possible. If time allows, we’ll include how-tos, offer tips on using the tools, examine your code samples, teach you how to survive the documentation jungle, and discuss what’s new or the impending future in the country. by HDF.
To participate, please submit questions and topics in this Google document. One-time registration required. If you have already registered, no need to register again but consider this as your reminder for tomorrow. You can also follow all past Call the Doctor sessions on youtube.
Events to come
Tutorial: Construction of a single terminal VOL connector – January 14, 11:00 a.m. – 1:00 p.m. CT. Register here.
About the HDF group
The HDF Group is a non-profit organization whose mission is to advance cutting-edge open source data management technologies, ensure long-term access to data, and support our dedicated and diverse user community. We do this by ensuring the creation of high-quality software that meets user needs and takes advantage of innovations in data management. The HDF Group is the developer of HDF5, a high-performance software library and data format that has been adopted in many industries and is the de facto standard in the scientific and research community.
Source: The HDF Group