Announcer The following program features simulated voices generated for educational and philosophical exploration.

Cynthia Woods Good afternoon. I'm Cynthia Woods.

Todd Davis And I'm Todd Davis. Welcome to Simulectics Radio.

Todd Davis The measurement problem in quantum mechanics has persisted for nearly a century. When we observe a quantum system, we find it in a definite state—spin up or spin down, here or there. Yet the Schrödinger equation describes the system as existing in superposition of all possibilities until measurement collapses the wave function. This collapse is problematic. It's not described by the Schrödinger equation. It seems to require an observer, raising questions about what constitutes observation and whether consciousness plays a role. It appears instantaneous and nonlocal, conflicting with relativity. Most troublingly, it's unclear whether collapse is real or merely reflects our ignorance. Does extending quantum mechanics to quantum field theory—the relativistic framework describing particles as excitations of underlying fields—resolve, exacerbate, or fundamentally transform the measurement problem?

Cynthia Woods Quantum field theory is our most successful physical theory. It describes electromagnetism, weak and strong nuclear forces, and predicts phenomena like the Lamb shift and the anomalous magnetic moment of the electron to extraordinary precision. The Standard Model, formulated as a quantum field theory, has been confirmed by decades of experiments culminating in the Higgs boson discovery. Yet quantum field theory inherits quantum mechanics' interpretational puzzles. Fields exist in superpositions. Measurements yield definite outcomes. The formalism works perfectly for calculating scattering amplitudes and decay rates, but when we ask what happens during measurement—when a photon interacts with a detector, when an electron creates a track in a cloud chamber—we face the same conceptual difficulties that plague non-relativistic quantum mechanics, potentially amplified by relativistic causality and the infinite degrees of freedom present in field theory.

Todd Davis Joining us to explore whether quantum field theory makes the measurement problem worse and whether pilot-wave theories can extend to relativistic domains is Dr. Sheldon Goldstein, mathematician and physicist at Rutgers University, known for his work on the foundations of quantum mechanics and Bohmian mechanics. Welcome, Dr. Goldstein.

Dr. Sheldon Goldstein Thank you. The measurement problem is not merely interpretational—it's a real gap in quantum theory's formulation. Quantum field theory, despite its empirical success, doesn't resolve this gap and arguably makes it more acute.

Cynthia Woods How does the measurement problem manifest in quantum field theory?

Dr. Sheldon Goldstein The core issue remains identical to non-relativistic quantum mechanics. The theory provides a wave function—or more precisely, a state vector in Fock space—evolving unitarily according to field equations. This evolution is deterministic and linear. Yet when we perform measurements, we observe definite outcomes with probabilities given by the Born rule. The wave function appears to collapse from superposition to eigenstate. This collapse is not part of the unitary dynamics. In quantum field theory, the measurement problem is particularly stark because we're describing particle creation and annihilation. When we detect a photon, we're claiming a field excitation has been localized to a detector. But the photon's wave function—the field's quantum state—may be spread across space. How does this extended state become localized upon detection? The formalism doesn't tell us. We have calculational rules that work, but no coherent account of what's physically happening during measurement.

Todd Davis Does relativistic causality make the measurement problem worse?

Dr. Sheldon Goldstein It certainly complicates it. In non-relativistic quantum mechanics, instantaneous collapse across space is puzzling but not obviously contradictory because the theory isn't relativistic. In quantum field theory, we're committed to Lorentz invariance and causal structure. Wave function collapse, if taken literally, appears to violate this. Consider an entangled state of two photons traveling in opposite directions. Measuring one photon's polarization instantly determines the other's, regardless of spatial separation. This looks like faster-than-light influence, though standard interpretations maintain it doesn't allow signaling. But the tension is palpable. Either collapse is real and we need to explain how it respects relativistic causality, or collapse is not real and we need an alternative account of why measurements yield definite outcomes. The field theory framework doesn't resolve this. It inherits quantum mechanics' measurement problem while adding relativistic constraints that make casual collapse stories harder to maintain.

Cynthia Woods What about decoherence? Doesn't interaction with the environment explain apparent collapse?

Dr. Sheldon Goldstein Decoherence is important but insufficient. It explains why interference effects become unobservable when quantum systems interact with large environments. The reduced density matrix describing the system alone becomes effectively diagonal in a preferred basis—typically the basis in which measurement is performed. This explains why we don't see macroscopic superpositions and why certain bases are naturally selected. But decoherence doesn't solve the measurement problem. After decoherence, we still have a superposition—just one whose different branches don't interfere. The question remains: why do we observe one outcome rather than experiencing superposition? Decoherence converts a pure state superposition into a mixed state from the perspective of the subsystem, but the total system—object plus environment—remains in a pure superposition. We still need either collapse to select one branch or an interpretation explaining determinate experience within continuing superposition. Decoherence is part of the story, but it's not the whole story.

Todd Davis Can pilot-wave theory, or Bohmian mechanics, extend to quantum field theory?

Dr. Sheldon Goldstein Pilot-wave theory offers a clear ontology for non-relativistic quantum mechanics. Particles have definite positions at all times, guided by the wave function according to a deterministic equation of motion. The wave function never collapses—it always evolves according to Schrödinger equation. What appears as randomness in measurement outcomes reflects our ignorance of initial positions, which are distributed according to the Born rule. This resolves the measurement problem completely: measurements reveal pre-existing positions rather than creating them through collapse. Extending this to quantum field theory is challenging but possible. The natural approach treats field configurations—values of the field at each spacetime point—as the primitive ontology, with the quantum state guiding field evolution. Several Bohmian field theories have been formulated, including for scalar fields, fermions, and even gauge theories. These maintain the key feature: definite field configurations exist at all times, guided by the wave functional.

Cynthia Woods What are the difficulties in making pilot-wave theory relativistic?

Dr. Sheldon Goldstein The central tension is between nonlocality and relativistic covariance. Pilot-wave theory is explicitly nonlocal—the velocity of one particle depends instantaneously on the positions of all other particles through the wave function. This seems to conflict with special relativity's prohibition on faster-than-light causation. However, the situation is subtle. The theory can be formulated in a way that respects Lorentz invariance of empirical predictions—all observable statistics are relativistic. The nonlocality is confined to the velocity equation defining how particle positions evolve. Since these velocities aren't directly observable—only statistical distributions are—the theory can maintain empirical Lorentz invariance while having a preferred foliation of spacetime in its formulation. This is philosophically uncomfortable but technically viable. Some researchers prefer manifestly covariant formulations using spacetime histories rather than particle trajectories, though these face their own challenges. The key point is that pilot-wave theory can reproduce quantum field theory's empirical predictions while providing a clear ontology that resolves the measurement problem.

Todd Davis Does this mean the measurement problem is solved in principle, even if the solution is theoretically uncomfortable?

Dr. Sheldon Goldstein For non-relativistic systems and scalar field theories, yes. Pilot-wave mechanics provides a complete, deterministic theory reproducing all quantum mechanical predictions without wave function collapse or measurement postulates. The measurement problem is solved because there's no collapse—particles or field configurations simply have definite values at all times, and measurements reveal these pre-existing values. The theory's discomfort comes from its explicit nonlocality and the need for a preferred foliation when formulating relativistic versions. But this discomfort is arguably less severe than the measurement problem it solves. For more complex field theories—particularly gauge theories like electromagnetism and Yang-Mills theories—technical challenges remain. Gauge freedom complicates defining what the primitive ontology should be, since not all gauge field configurations correspond to physically distinct states. These challenges aren't insurmountable, but they require careful treatment. Various approaches have been proposed, with ongoing research exploring which provides the most natural formulation.

Cynthia Woods Why hasn't pilot-wave theory been more widely adopted if it solves the measurement problem?

Dr. Sheldon Goldstein Several sociological and pedagogical reasons contribute. First, most physics education presents the Copenhagen interpretation or instrumentalist views that avoid ontological commitments. Students learn to calculate and predict without asking what quantum mechanics describes. Pilot-wave theory is rarely taught, so most physicists aren't familiar with it. Second, there's a widespread but mistaken belief that von Neumann's theorem proved hidden variable theories impossible. This was refuted by Bell, who showed von Neumann's assumptions were too restrictive, but the myth persists. Third, the theory's explicit nonlocality makes some physicists uncomfortable, even though all quantum theories—including standard formulations—involve nonlocality through entanglement, just hidden rather than explicit. Fourth, for practical calculations, pilot-wave theory and standard quantum mechanics give identical predictions, so there's no empirical reason to switch for most working physicists focused on applications rather than foundations. Finally, there's intellectual inertia. The standard interpretation, despite its problems, has become familiar, and changing foundational frameworks requires overcoming significant institutional momentum.

Todd Davis What would constitute empirical evidence distinguishing pilot-wave theory from other interpretations?

Dr. Sheldon Goldstein This is difficult because pilot-wave theory is constructed to reproduce quantum mechanical predictions exactly. For standard quantum mechanics, there's no empirical difference—that's by design. However, potential distinctions might emerge in exotic regimes. Some researchers have proposed that departures from exact Born rule distribution for initial conditions—relaxation to quantum equilibrium—might be testable in systems isolated from equilibrating interactions. Others suggest quantum gravity might favor certain ontological structures over others, potentially providing indirect evidence. More promisingly, modifications or extensions of quantum theory might look different in pilot-wave formulation versus collapse theories or many-worlds. For instance, gravitational modifications to quantum mechanics, as proposed by Penrose, might have distinct pilot-wave analogs. But fundamentally, we should recognize that interpretations reproducing identical empirical predictions can't be distinguished experimentally. The choice between them becomes a matter of coherence, conceptual clarity, and ontological commitment rather than empirical test.

Cynthia Woods How do pilot-wave approaches compare to collapse theories like GRW or CSL?

Dr. Sheldon Goldstein Collapse theories and pilot-wave theories take opposite approaches to the measurement problem. Collapse theories modify quantum mechanics by adding stochastic collapse terms to the Schrödinger equation. These cause spontaneous localization with rates negligible for microscopic systems but significant for macroscopic superpositions, explaining why we observe definite macroscopic states. Theories like Ghirardi-Rimini-Weber and continuous spontaneous localization are explicitly non-unitary—the wave function genuinely collapses through physical processes. These theories make predictions slightly different from standard quantum mechanics and are in principle testable. Pilot-wave theory doesn't modify quantum mechanics—the wave function always evolves unitarily. Instead, it adds an ontology of particle positions or field configurations guided by the wave function. There's no collapse, stochastic or otherwise. The key difference is ontological strategy: collapse theories modify dynamics to eliminate superpositions, while pilot-wave theories accept superpositions in the wave function but add primitive ontology that's always definite. Both solve the measurement problem but in fundamentally different ways.

Todd Davis What does the persistence of the measurement problem tell us about physics as a discipline?

Dr. Sheldon Goldstein It reveals a tension between physics' pragmatic and foundational aspects. Pragmatically, quantum mechanics and quantum field theory are extraordinarily successful. We can calculate scattering cross-sections, predict particle properties, design quantum technologies—all without resolving the measurement problem. This success creates complacency about foundations. Why worry about interpretation when the theory works? But this pragmatism comes at a cost. We're using a theory we don't fully understand in a deep sense. We have calculational rules without clear physical pictures of what's happening. The measurement problem highlights that quantum theory, as usually formulated, isn't a complete physical theory—it's a predictive framework requiring external assumptions about measurement. A complete theory should describe all physical processes, including measurement, in the same terms without special postulates. The persistence of the measurement problem shows we haven't achieved this, despite quantum theory's age and success. This should concern us not just philosophically but scientifically, because incomplete understanding might limit our ability to extend the theory correctly—to quantum gravity, cosmology, or new domains where our current formulation might fail.

Cynthia Woods Does quantum field theory's success despite these foundational issues suggest foundations don't matter?

Dr. Sheldon Goldstein No. It suggests that for many applications—calculating particle interactions, predicting scattering amplitudes, designing accelerators—the foundational issues don't arise. These calculations involve prepared initial states and measured final states, with the quantum formalism interpolating between preparation and measurement. The measurement problem concerns what happens during measurement itself and whether the theory describes reality between measurements. For practical applications, we can sidestep these questions. But foundations matter for multiple reasons. First, understanding what a theory says about reality is intrinsically valuable—it's what science is supposed to do beyond mere prediction. Second, foundational clarity might be essential when extending theories to new domains. Quantum gravity, cosmology of the early universe, and consciousness might require understanding quantum mechanics more deeply than instrumentalist approaches provide. Third, foundational confusions might be masking deeper physics. The measurement problem might signal that quantum mechanics is incomplete in ways that matter for phenomena we haven't yet encountered. Finally, pedagogically, teaching students a theory while telling them not to ask what it means is intellectually unsatisfying and potentially harmful to developing clear physical intuition.

Todd Davis Can we apply quantum mechanics to the universe as a whole without resolving the measurement problem?

Dr. Sheldon Goldstein This is where the measurement problem becomes most acute. Standard quantum mechanics requires an external observer or measurement apparatus. But if we're describing the entire universe, there's no external observer. Where do we put the Heisenberg cut separating quantum system from classical apparatus? What constitutes measurement if everything is quantum? These questions force us toward interpretations that don't rely on measurement or observers. Many-worlds, pilot-wave theory, and collapse theories can all describe closed quantum systems including the entire universe. Standard Copenhagen or instrumentalist interpretations cannot—they fundamentally require something outside the quantum description. Cosmology has driven renewed interest in quantum foundations precisely because we need to apply quantum mechanics to cosmological inflation, the wave function of the universe, and early universe conditions where no observers exist. We can't hide behind pragmatism when there's no external vantage point to define measurement. This suggests that foundational questions we could ignore in laboratory contexts become unavoidable when doing cosmology.

Cynthia Woods Dr. Goldstein, thank you for exploring how quantum field theory relates to the measurement problem and whether pilot-wave approaches offer resolution.

Dr. Sheldon Goldstein Thank you. The measurement problem remains central to understanding what quantum theory—relativistic or not—actually tells us about physical reality.

Todd Davis Tomorrow we examine how Hawking radiation emerges from quantum field theory in curved spacetime.

Cynthia Woods Until then. Good afternoon.