Oil and Gas Industry Overview

The oil and gas industry underpins the global economy in ways that are both visible and invisible to most people outside it. It fuels transportation, powers industry, provides the feedstock for plastics, pharmaceuticals, fertilisers, and an enormous range of manufactured goods, and employs millions of people across an interconnected global value chain that stretches from remote drilling locations to petrol station forecourts. Understanding how that value chain works, from the geological exploration that finds hydrocarbons to the retail sale of refined products, is essential knowledge for anyone working in or with the industry.

This guide provides a comprehensive, accessible overview of the three segments of the oil and gas value chain, the key activities, technologies, and business models in each, how they interact, and the major trends reshaping the industry as the energy transition progresses.

---

Key Takeaways

Upstream Exploration and Production (E&P): finding oil and gas reserves through geological surveying and seismic analysis, drilling to confirm them, and producing them from the reservoir to the surface. The most capital-intensive and technically complex segment.

Midstream Transportation, processing, and storage: moving crude oil and natural gas from the wellhead to the refinery or export terminal through pipelines, tankers, and processing facilities. The infrastructure backbone of the industry.

Downstream Refining and marketing: converting crude oil into usable products (petrol, diesel, jet fuel, lubricants, petrochemical feedstocks) and distributing and selling them to end users. The segment closest to consumers.

Energy transition Is reshaping the industry’s long-term outlook. Oil and gas demand is expected to peak and decline over the coming decades, driving major oil companies to diversify into renewables, CCS, and low-carbon fuels while continuing to manage existing hydrocarbon assets efficiently

• The oil and gas industry value chain is conventionally divided into three segments: upstream (exploration and production), midstream (transportation, processing, and storage), and downstream (refining, distribution, and marketing). Integrated oil companies (IOCs) such as Shell, BP, ExxonMobil, and TotalEnergies operate across all three; national oil companies (NOCs) and independent E&P companies focus on specific segments.
• Oil and gas are fundamentally different commodities requiring different production, transportation, and processing infrastructure. Oil is a liquid that can be stored and transported by tanker and pipeline. Natural gas must be either transported by pipeline or liquefied (LNG) for ocean shipping, which requires substantial cryogenic infrastructure at both the liquefaction and regasification ends.
• The oil price is the single most influential variable in the economics of the entire value chain. It determines which reserves are economically viable to develop, which refineries are profitable to operate, and what returns the industry earns on its enormous capital base.
• The energy transition is the most significant structural challenge the oil and gas industry has faced. Global demand for oil products is expected to peak in the 2020s to 2030s under most scenarios, while natural gas is expected to remain in demand longer as a transition fuel. Managing this transition while continuing to supply the hydrocarbons the world currently needs is the defining strategic challenge for all participants in the industry.

---

Upstream: Exploration and Production

The upstream segment encompasses everything from the initial search for oil and gas reserves to their extraction and delivery to a custody transfer point. It is the most technically complex and capital-intensive segment of the value chain, and the one with the highest risk: exploration wells fail to find commercial quantities of hydrocarbons more often than they succeed, and the costs of both successful and unsuccessful wells run into tens or hundreds of millions of dollars.

Exploration

Exploration begins with geological and geophysical analysis of prospective areas. Geologists study rock formations, structural traps, and source rock presence to identify areas with the right conditions for hydrocarbon accumulation. Geophysicists use seismic surveys (sending sound waves into the earth and analysing the reflections) to build detailed subsurface images that reveal the shape and thickness of potential reservoir formations. Modern 3D and 4D seismic technology has transformed exploration success rates compared to what was achievable with 2D seismic alone.

Exploration wells (wildcats) are drilled to test whether a geological prospect contains commercial quantities of hydrocarbons. If hydrocarbons are found, appraisal wells are drilled to determine the size and quality of the accumulation. Only a fraction of exploration wells result in commercial discoveries; the rest are plugged and abandoned.

Development and Production

Once a discovery is confirmed as commercially viable, the field moves into development: designing and installing the production infrastructure (wells, wellhead equipment, processing facilities, pipelines, and in offshore fields, platforms or floating production units), drilling production wells, and beginning production. Development planning must account for the reservoir’s natural energy (pressure that drives hydrocarbons to the surface), which declines over a field’s life and may require enhanced recovery techniques (water or gas injection, chemical flooding) to sustain production rates.

Production operations manage the ongoing extraction of hydrocarbons from the reservoir, the separation of oil, gas, and water at the surface, the treatment and export of each stream, and the safe management of the produced water and associated gas that comes with the oil. Maintaining reservoir pressure, managing well integrity, and optimising production rates against reservoir behaviour are the core technical challenges of the production phase.

Asset integrity and maintenance management are critical in upstream operations. Our article on what is reliability-centred maintenance (RCM) and how do you implement it covers the maintenance strategy discipline that is particularly important in offshore and remote upstream environments where equipment failure has severe safety and production consequences.

---

---

Midstream: Transportation, Processing, and Storage

The midstream segment provides the physical infrastructure that moves hydrocarbons from producing fields to the refineries, petrochemical plants, LNG export terminals, and power stations that use them. It is the least glamorous segment of the value chain but one of the most critical: without reliable midstream infrastructure, upstream production has nowhere to go and downstream facilities have nothing to process.

Pipelines

Onshore pipelines are the most cost-effective way to transport large volumes of oil and gas over land. Major oil pipeline networks span thousands of kilometres, crossing national borders, mountain ranges, and challenging terrain. Gas pipelines require compression stations at intervals to maintain pressure and flow rates. Pipeline integrity management, corrosion monitoring, and leak detection are the primary operational challenges of pipeline operations.

Offshore pipelines connect subsea wellheads and manifolds to platform facilities or shore-based terminals. The engineering challenges of laying and operating deepwater pipelines in extreme environments, high pressure, low temperature, significant seabed movement, have driven continuous technological advancement in both pipeline materials and installation methods.

LNG: Liquefied Natural Gas

Natural gas that cannot be transported by pipeline (because of distance, ocean crossings, or political barriers) must be liquefied for shipping. Liquefaction reduces natural gas to 1/600th of its gaseous volume by cooling it to approximately -162 degrees Celsius, making ocean transport viable. LNG trains (liquefaction facilities) are among the most complex and expensive industrial installations ever built, costing tens of billions of dollars for large-scale projects.

At the receiving end, LNG is offloaded into storage tanks and then regasified for injection into the receiving country’s gas network. The global LNG market has grown dramatically over the past two decades and is now a significant factor in global gas price formation, connecting markets that were previously isolated by geography.

Gas Processing

Natural gas produced from wells contains water vapour, hydrogen sulphide, carbon dioxide, and heavier hydrocarbons (ethane, propane, butane, pentane) alongside the methane that is the primary product. Gas processing plants remove impurities and separate the heavier hydrocarbons (natural gas liquids, or NGLs) that have significant value as petrochemical feedstocks and as LPG for heating and cooking.

Downstream: Refining, Distribution, and Marketing

The downstream segment converts crude oil into the refined products that the world’s economy runs on, and distributes and markets those products to end users. Refining is the process of breaking down crude oil’s complex mixture of hydrocarbons into specific product streams through distillation, cracking, reforming, and treating processes.

Oil Refining

Crude oil is first separated into fractions by boiling point in an atmospheric distillation column: the lightest fractions (naphtha, kerosene, diesel, gas oil) come off as vapours at different heights in the column; heavier fractions (residual fuel oil) remain at the bottom. These primary distillation fractions are then processed further to produce the specific products the refinery is designed to make.

Modern refineries use a range of conversion processes to maximise the yield of high-value light products from the heavy crude fractions that primary distillation produces. Fluid catalytic cracking (FCC) and hydrocracking break heavy molecules into lighter ones. Reforming converts naphtha into high-octane gasoline blending components and hydrogen. Alkylation combines light olefins into high-octane gasoline. The specific configuration of conversion units determines a refinery’s ability to process different crude qualities and produce different product slates.

Petrochemicals

A significant proportion of oil and gas is not burned as fuel but used as feedstock for the petrochemical industry: the production of ethylene, propylene, benzene, and other building block chemicals that are converted into plastics, synthetic fibres, rubber, pharmaceuticals, fertilisers, detergents, and thousands of other manufactured products. The petrochemical industry is expected to be the largest driver of oil demand growth in the coming decades even as transport fuel demand peaks and declines.

For professionals working in the oil and gas industry who also manage projects in this complex, capital-intensive sector, our article on construction project management: key competencies every site manager needs covers the project management disciplines that are particularly critical in oil, gas, and petrochemical construction and turnaround environments.

---

---

The Energy Transition and Its Impact on Oil and Gas

The energy transition is the most significant structural force reshaping the oil and gas industry. As renewable energy costs have fallen dramatically and climate policy has tightened globally, the long-term outlook for oil and gas demand has become more uncertain and contested than at any point in the industry’s history.

The broad consensus among analysts is that global oil demand will peak sometime in the 2020s to 2030s and then decline as electric vehicles displace internal combustion engines and industrial efficiency improves. Natural gas is expected to remain in demand longer as a lower-carbon transition fuel for power generation and industry, particularly as coal-to-gas switching continues in Asia. Petrochemicals are expected to sustain oil demand even as transport fuel demand falls.

The strategic response of major oil and gas companies to this transition varies significantly. Some IOCs, particularly European majors, have made substantial investments in renewables, power, and low-carbon technologies alongside their hydrocarbon businesses. Others, particularly US independents and some NOCs, have maintained a hydrocarbon-focused strategy, arguing that the world will continue to need oil and gas in quantity for decades and that the best return on capital is investing in efficient, low-cost hydrocarbon production rather than diversifying into lower-return renewables businesses.

The operational safety implications of managing the energy transition, and the continued need for rigorous process safety in existing oil and gas operations during this period, are covered in our article on what is process safety management and why does it matter.

Key Commercial and Commercial Concepts

Understanding the oil and gas industry also requires familiarity with its core commercial concepts. The oil price benchmark system uses reference crudes (Brent for international markets, WTI for North American markets) from which other crude grades are priced at differentials reflecting quality (API gravity, sulphur content) and location. Crude trading is one of the world’s largest commodity markets, with millions of barrels changing hands daily through a combination of long-term contracts, spot sales, and financial derivatives.

Production Sharing Contracts (PSCs) and concession agreements are the principal legal frameworks through which oil companies access government-owned hydrocarbon resources. Under a PSC, the company bears exploration and development costs and recovers them from production before sharing remaining profit oil with the host government according to agreed terms. Understanding these fiscal frameworks is essential for professionals working in commercial, legal, or finance roles in upstream E&P.

Conclusion: An Industry in Transition

The oil and gas industry will remain critically important to the global economy for decades, even as the energy transition reshapes its long-term trajectory. Understanding how the industry works, from the geological science of exploration through the engineering of production and the chemistry of refining to the commercial frameworks that govern investment and trade, is valuable knowledge for any professional working in or with this sector.

The skills required to operate in the oil and gas industry effectively, from technical engineering disciplines through project management to commercial and safety management, are among the most demanding and most transferable in any industrial sector. The professionals who combine deep technical knowledge with commercial literacy, project delivery capability, and safety leadership are those who will navigate the industry’s transition most successfully.

Related reading: Safety management is central to all three segments of the oil and gas value chain. Our article on what is a safety management system and how do you implement one covers the ISO 45001-aligned safety management framework that underpins safe operations in upstream, midstream, and downstream environments.

---