The OSDU™ Platform

Access OSDU data today with Spotfire

The Open Group OSDU Platform is a standard data platform that is being developed for the oil and gas industry, which will reduce silos and put data at the center of the subsurface community. OSDU stands for Open Subsurface Data Universe (standards).

The OSDU Custom Connector allows Spotfire® users to authenticate against their OSDU Platform deployments using OpenID®: 

Download your OSDU R3 Custom Connector today and be ahead of the curve analyzing OSDU data.

Learn how to access OSDU Data from Spotfire®.

OSDU Project Overview

Spotfire is really proud to support and enable our customers working on OSDU data. The OSDU is developing a standard data platform for the oil and gas industry, which will reduce silos and put data at the center of the subsurface community.

The OSDU data platform will:

• Enable secure, reliable, global, and performant access to all subsurface and wells data
• Reduce current data silos to enable transformational workflows
• Accelerate the deployment of emerging digital solutions for better decision-making
• Create an open, standards-based ecosystem that drives innovation

This will revolutionize the industry's ability to deliver new capabilities and reduce implementation and lifecycle costs across the subsurface community.

Target

Data at the Center: All Subsurface and Wells Data Stored in a Single Data Platform

• Multiple OSDU instances, acting as one, around the world addressing the latency distance limitations between 3D users and their applications/data:
  • When using 3D apps the maximum distance for reasonable performance is approximately 40 MSEC. This means for global Operators that they need multiple OSDU Platform implementations around the world. In this case, Meta and Master data is replicated around the world and real data remains in the region it belongs
• Data (structured/unstructured/real-time) to be stored using standard data formats. We move away from proprietary formats and focus on formats that we can use more broadly
• Extracting Metadata to ensure that all data in the OSDU Data Platform can be located using Search or latest Graph technologies: We should be able to do shallow and deep search
• Master data ensuring that we have a single set of definitions across OSDU and adjacent Data Platforms
• A well-defined set of APIs providing a standard way of accessing the data in the OSDU Data Platform. Make sure that all applications can use a single set of APIs to access all data sources in the OSDU platform

New Generation of Applications being Developed/Acquired:

• Flexible orchestration of workflows
• (Micro) Services driven
• Kubernetes support: All microservices are Kubernetes driven
• User Interface: HTML5 driven (including 3D support) and therefore support for any device such as tablets, phones, etc
• Getting enabled for VR Collaboration support: Important for global cooperation
• Both Physics and Data-Driven applications: The latter category gets more and more important when thinking about Machine Learning, etc
• Artificial Intelligence: Exploiting Machine Learning wherever possible
• Support for existing apps: Often you have existing apps, based on MS Windows desktop/Linux desktop, and we have the opportunity to do an lift and shift of these applications to the OSDU platform

Scope

Current Scope

• Coverage: any organization with a need to store, manage or analyze subsurface and wells data
• Portfolios: subsurface including exploration, development, and wells
• Support for Data-Driven (Artificial Intelligence) Applications: All data in one Data Platform will enable AI (such as Machine Learning) based applications to access this data

Current Problem Statement

• Data is linked to applications: we are not data-driven but applications-driven and, therefore, we will have silos
• Data is stored in silos: therefore, there is no lineage between data sources or from wells back to exploration
• Metadata is not stored with the data: metadata is information about the data
• Limited/no search capabilities: since we have no metadata, we have no real search capabilities
• Data set-up: not suitable for data-driven applications

OSDU Scope

• All public cloud-based: provides unlimited scalability
• All data for the data platform services loaded via the data ingestion services: extract metadata, data quality, etc.
• Well-defined (RestFUL) APIs defining the access to the data platform services
• Applications: (micro) services-based
• Information security: covering all elements with a focus on data security
• In-country solution: for those countries where we are unable to move data out of the country and where there are no cloud services
• Support for legacy applications based on Microsoft® Windows or Linux® desktop

Business Impact

The OSDU Forum will:

• Publish a Reference Architecture: a cloud-native subsurface and wells data platform reference architecture with initial implementations by Microsoft® Azure and Amazon Web Services® and Google® GCP, with others expected
• Define Application Standards to ensure applications (microservices) developed by various parties, can run on the same OSDU data platform
• Leverage Industry Data Standards for frictionless integration and data access

This will result in:

• Reducing data silos: subsurface data integrated and accessible in one data platform
• Workflows in the cloud: user workflows seamlessly executed across the OSDU platform, taking advantage of powerful cloud-native solutions
• Access to all metadata: users will have access to powerful search capabilities
• Competition and co-operation: software vendors, oil companies, academia, and open community projects can develop software on the OSDU data platform

Membership

Be a part of the future, become a member of OSDU today: https://www.opengroup.org/membership

For a full list of members, visit HERE

Download the OSDU brochure from here osdu_brochure_sept-web.pdf

Spotfire Analytics

Spotfire Analytics is a comprehensive insight platform for visualization, modeling, streaming, data management, and model ops. The following software was showcased at The Analytics Forum 2023:

1. Spotfire Visual Analytics - The most comprehensive visual analytics platform on the market with built-in data wrangling, predictive modeling, and real-time analytics
2. Spotfire Data Science - Collaborative advanced analytics platform, helping Data Scientists model, deploy, and scale AI/ML solutions across their organization
3. Spotfire Streaming - Enterprise-grade, cloud-ready streaming analytics for quickly building real-time applications at a fraction of the cost and risk of alternatives
4. TIBCO Data Virtualization - Enterprise data virtualization solution that federates access across multiple and varied data sources

Acknowledgments & References

Special thanks to the Spotfire Data Science team who are working on these analyses using Spotfire (Visual Analytics; Python): Michael O'Connell, Vinoth Manamala, Andrew Berridge.

	Michael O'Connell, Ph.D., is the chief analytics officer at Spotfire, where he helps clients with analytics software applications that drive business value. He has written a bunch of scientific papers and software packages on statistical methods. He also likes listening to electronic music; watching basketball, football and cricket; going to art galleries and walking around neighborhoods.
	Vinoth Manamala is a Data Scientist at Spotfire, based in Toronto. He is passionate about solving complex industry problems using Big Data and machine learning. He brings his experience to his current role where he works with organizations to use their data assets to their fullest potential in support of their business operations. He is an avid sportsperson; plays cricket and badminton, and also loves to travel for nature and food.
	Andrew Berridge is a Senior Staff Data Scientist at Spotfire. He specializes in extending, customizing and developing Spotfire and driving its future in all industries. He is the author of Spotfire, A Comprehensive Primer 2nd Edition (Packt). He loves restoring classic cars and playing in orchestras in his spare time.