From physical assumptions to classical and quantum Hamiltonian and Lagrangian particle mechanics
Gabriele Carcassi, Christine A. Aidala, David J. Baker, Lydia Bieri

TL;DR
This paper derives classical and quantum particle mechanics from fundamental physical assumptions, showing how different assumptions lead to Hamiltonian and Lagrangian formulations.
Contribution
It introduces a unified framework deriving classical and quantum mechanics from simple physical principles, clarifying their foundational differences.
Findings
Classical mechanics emerges from infinitesimal reducibility assumption.
Quantum mechanics arises from irreducibility assumption.
Lagrangian mechanics results from the kinematic equivalence assumption.
Abstract
The aim of this work is to show that particle mechanics, both classical and quantum, Hamiltonian and Lagrangian, can be derived from few simple physical assumptions. Assuming deterministic and reversible time evolution will give us a dynamical system whose set of states forms a topological space and whose law of evolution is a self-homeomorphism. Assuming the system is infinitesimally reducible---specifying the state and the dynamics of the whole system is equivalent to giving the state and the dynamics of its infinitesimal parts---will give us a classical Hamiltonian system. Assuming the system is irreducible---specifying the state and the dynamics of the whole system tells us nothing about the state and the dynamics of its substructure---will give us a quantum Hamiltonian system. Assuming kinematic equivalence, that studying trajectories is equivalent to studying state evolution, will…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
From physical assumptions to classical and quantum
Hamiltonian and Lagrangian particle mechanics
Gabriele Carcassi, Christine A. Aidala, David J. Baker, Lydia Bieri
University of Michigan, Ann Arbor, MI 48109
Abstract
The aim of this work is to show that particle mechanics, both classical and quantum, Hamiltonian and Lagrangian, can be derived from few simple physical assumptions. Assuming deterministic and reversible time evolution will give us a dynamical system whose set of states forms a topological space and whose law of evolution is a self-homeomorphism. Assuming the system is infinitesimally reducible—specifying the state and the dynamics of the whole system is equivalent to giving the state and the dynamics of its infinitesimal parts—will give us a classical Hamiltonian system. Assuming the system is irreducible—specifying the state and the dynamics of the whole system tells us nothing about the state and the dynamics of its substructure—will give us a quantum Hamiltonian system. Assuming kinematic equivalence, that studying trajectories is equivalent to studying state evolution, will give us Lagrangian mechanics and limit the form of the Hamiltonian/Lagrangian to the one with scalar and vector potential forces.
Hamiltonian mechanics and Lagrangian mechanics and Quantum mechanics and Fundamental assumptions
I Introduction
The past century has seen a resounding success in the use of mathematics in fundamental physics. In many cases, mathematical ideas were what allowed progress in theoretical physics and ultimately led to experimental discoveries. While these ideas are indeed useful—anything that can advance our understanding is welcome—they cannot be the whole story.
The issue is that mathematical structures are not enough to characterize what physical system is being studied. For example, the same mathematical framework for linear circuits can be used to describe electric, hydraulic, thermal or mechanical systems Roland ; Barron ; Borutzky . The mathematical treatment is the same because it captures aspects of the description that are common to all cases; that indeed is its power. But for the very same reason, we cannot infer what system is being described if all we are given is the mathematical model. In the jargon of linguistics/computer science/philosophy Freidin ; Friedman : math captures the syntax (the relationships between the objects) but does not capture the semantics (the meaning of each object).
The real problem begins when the mathematical description essentially becomes the foundation of a physical theory. While some branches of physics, such as Newtonian mechanics, thermodynamics and special relativity, are founded on physical laws or assumptions, others, such as Hamiltonian, Lagrangian and quantum mechanics, start by setting their mathematical structure. Nothing tells us why there should be a Lagrangian function whose path integral is minimized during the motion, or when a state is described by conjugate pairs instead of a vector in a complex inner product space. Those are taken as given.
This means that if we have a system in front of us, we do not have a rigorous way to conceptually establish whether the system is Hamiltonian or not, whether it is classical or quantum. We have some heuristics we can apply, but, at the end the day, a system is Hamiltonian because it follows the Hamiltonian framework.111The lack of a properly defined, and uniquely accepted, semantics is of course very evident in quantum mechanics with its numerous interpretations.
Unsatisfied with this situation, we started creating a sort of math-to-physics dictionary so that each mathematical concept could be clearly associated to a crisp physical concept. As we pushed further back toward the basic mathematical definitions, we ended up with physical concepts of a more general nature and found that, in some cases, a single physical idea could have more than one mathematical consequence. That is: by putting physics at the center, we could achieve a unification of ideas that was not evident before. The unexpected success of the approach led us to think that, perhaps, the picture we were developing was a better framework to understand and link different areas of basic science and mathematics. This work is the systematized result of this endeavor.
The main goal is to show that it is possible to derive classical/quantum Hamiltonian/Lagrangian particle mechanics starting from few physical assumptions. We do not claim that we have perfectly achieved this result, with no room for improvement. We do claim that the whole architectural framework is solid enough to be convinced that not only is this indeed possible, but it allows a more unified picture that facilitates intuitive connections within and across different areas of physics and mathematics. It enables a consistent narrative across several domains of knowledge.
Rederiving classical, quantum and (to some extent) relativistic mechanics within the same work is therefore crucial to show that the concepts we develop are truly general, and they can be applied to many different cases. If we could derive classical Hamiltonian mechanics on assumptions that are inapplicable to the quantum case, what good would it do? Quantum systems are Hamiltonian systems, so clearly we wouldn’t have understood what makes a system Hamiltonian. This breadth of applicability is what makes the work valuable.
As a brief overview, there are four assumptions we will consider. Assuming deterministic and reversible evolution gives us a dynamical system: states and a law of evolution. Additionally assuming infinitesimal reducibility, studying the whole system is equivalent to studying its infinitesimal parts, gives us Hamiltonian mechanics. Further assuming kinematic equivalence, trajectories in space tell us everything about the state of the system, gives us Lagrangian mechanics and constrains the motion to massive particles under scalar/vector potential forces. Relativistic motion arises when studying time dependent laws of evolution with no further assumptions. Alternatively, as the second assumption we can instead take irreducibility, studying the whole system tells us nothing about its parts, which leads to quantum (Hamiltonian) mechanics.
As a more detailed overview: in section III we describe in general what it means to study a physical system and how the assumption of determinism and reversibility plays into it. We develop an abstract conceptual model that we use when discussing the later assumptions.
In section IV we show how the physical concept of physical distinguishability leads to the mathematical concept of topological spaces. Deterministic and reversible evolution is an invertible continuous map (i.e. a homeomorphism) as it needs to preserve what is physically distinguishable.
In section V we introduce the notion of a classical material, one for which we assume infinitesimal reducibility. The state of an arbitrary amount of material is a distribution over the states of the infinitesimal parts, the classical particles. As such a distribution must be invariant under the arbitrary choice of units, we see that for each variable that defines a unit there is a corresponding variable defined on the inverse of that unit. Classical particle states can be identified by conjugate pairs of state variables (i.e. a point in the cotangent bundle ) and the number of possible initial conditions for each pair is given by (i.e. the canonical symplectic form ). During evolution, the distribution (and marginal distributions) must be mapped point by point which leads to Hamiltonian mechanics (i.e. a symplectomorphism on ).
In section VI we show that a relativistic version of Hamilton’s equations arises naturally when we consider time dependent laws of evolution for distributions of classical material. This also gives the notion of deterministic and reversible evolution a characterization that is independent of any transformation that mixes time and state variables . Moreover it gives us a classical equivalent for anti-particle states.
In section VII we introduce the assumption of kinematic equivalence, studying the motion in space is equivalent to studying the evolution of the state. Under that assumption there is a link between the state variables and the kinematic variables (i.e. position and velocity). This link allows us to express the number of possible initial conditions for a degree of freedom (d.o.f.) in terms of and , leading to the metric tensor . Such an expression also allows us to constrain the Hamiltonian to the one for massive particles under scalar/vector potential forces and an equivalent Lagrangian formulation.
In section VIII we introduce some ideas in classical mechanics to more gently transition to quantum mechanics. We see how distributions over phase space already have features that are typically associated with quantum systems and we will show how to construct a classical uncertainty principle that helps to build intuition used in the later section.
In section IX we introduce the notion of an irreducible material, one for which studying the whole distribution does not tell us anything about the motion of its infinitesimal parts, the fragments. A unit amount of this material will correspond to a quantum particle. As this means that the states of such a material are invariant under permutations of the configurations of the fragments, we show that the state space of an irreducible material is a complex vector space. These states can still be compared to each other in a way that gives the state space an inner product. Such comparisons will be preserved by deterministic and reversible evolution which leads to Schroedinger’s equation (i.e. a unitary transformation).
In section X we present a few higher level remarks about the work.
II Organization and style
The overall layout of this work is a balance between the need to show that the derivation follows, which requires starting from basic principles and proceeding using formal arguments, and the need to give an intuitive understanding, which often requires starting from specific cases and then generalizing.
The deductive aspect is formally organized into the following:
Assumptions:
these characterize the physical system we are studying and constitute the premise of our discussion. A rationale follows each assumption, which uses physical and sometimes philosophical arguments to motivate why (or not) such an assumption makes sense in a particular case.
Propositions:
these capture the properties of our physical objects into mathematical language. A justification follows each proposition to show the necessity of such a characterization. While it is a formal argument, it is not a strictly mathematical proof as it contains physical arguments.
Theorems:
these are pure mathematical statements that are used to simplify propositions. A mathematical proof follows each theorem. No mathematical breakthrough should be expected as we mostly use well known results from different fields. Theorems are grouped in the appendix.
As these sections are clearly demarcated, they allow us to make sure that each justification only references past propositions and avoid circular arguments. It also makes it easier to read the work at the desired level of detail. Interspersed between each step of the more formal treatment, there are numerous discussions that conceptually explain motivations and results in a more approachable way. These often provide more concrete and intuitive examples which may, in some cases, foreshadow later material. As both the formal and more intuitive parts need to cover the same material, this will inevitably lead to some repetition.
The work uses ideas and tools from a broad range of mathematical and scientific subjects: topology LeeTM , measure theory Halmos , differential geometry (symplectic and Riemannian) Lee , group theory and vector spaces Lang ; Young , statistics Grimmet , information theory Pierce , Hamiltonian mechanics, Lagrangian mechanics classical_dynamics , quantum mechanics Landau ; Weinberg , thermodynamics Van Ness , special relativity French and so on.222The references given provide the reader a list of resources consistent with the development of this work. Using ideas from all these areas is necessary and valuable, but it does create a number of problems.
The first one is terminology and prerequisite knowledge. Since we touch numerous areas, we cannot expect all readers to be equally comfortable with all the technical terms. Yet we cannot introduce all of them either. The compromise we adopted is to keep the informal discussion more accessible while keeping the formal derivation more precise, without needing more than the basic definitions and few major results within each specific area. This may leave an expert in a particular field not fully satisfied but, as stated in the introduction, our goal is to lay out the general picture.
The second problem is notation. As each field has developed its own set of conventions, the common usage is now an empty set. We ended up with a compromise that hopefully feels natural enough to a broad audience of physicists, mathematical physicists and philosophers of physics. Within formal parts we may use notation and terminology more specific to the appropriate area of math.
We have tested the prose on a number of colleagues and students in physics, philosophy and mathematics to confirm its accessibility at different levels and believe we have struck a reasonable compromise.
III On studying a physical system
Our first task is to develop a conceptual model that applies to all realms of physics we’ll be considering: classical, statistical and, later, quantum mechanics. We will take the standard picture of system plus environment and extend it to differentiate between the state of the system (i.e. the aspects under study) from the unstated part of the system (i.e. the aspects missing from our description).
We will assume that the state evolves according to a deterministic and reversible law (i.e. for each present state there is one and only one future state). While the unstated part does not influence the state evolution, we’ll see how it constrains what states are available and what type of description can or cannot be given to the system.
III.A States and their evolution
We start by fixing a physical system, meaning something we can interact with and perform measurements on (e.g. a planet, a fluid, …). We call environment everything else. We set what particular aspect we want to study (e.g. the motion around a star, the flow in a pipe, …). We call state a physically distinguishable configuration of the aspect under study at a particular time (e.g. position/momentum of center of mass, velocity field, …). Since the state does not, in general, exhaust the description of the system, a part remains unstated, and as such we’ll call it, for lack of a better word (e.g. the chemical composition, the motion of each of its molecules, …). Note that the environment plays an essential role here as it’s what allows us to define two states as physically distinguishable: we can find an external process (i.e. part of the environment) whose outcome changes depending on the different state. As such processes are what we can use to perform measurements, we consider the experimental apparatus (and us performing measurements) independent of the system, part of the environment.333This is true even in the case of general relativity, where we can imagine multiple researchers on small spaceships collecting data without greatly influencing the motion of stars and planets. The case where the physical system is the whole universe and there is no environment presents practical problems and conceptual challenges that the current physical theories do not seem to be equipped to address, and therefore will be absent from our discussion. For example, what physical device can we use to store and process the state of the whole universe to make predictions and compare? How do we define physically distinguishable? Do the physical laws determine which measurements we are going to make and does that limit what is actually distinguishable?
In this context, we call the evolution of the system deterministic if the state at a given time uniquely identifies states at future times, and reversible if it uniquely identifies states at past times. While this is a common enough definition, we need to be clear how this applies to the unstated part. Note that the concept of determinism outlined here is context dependent because the state itself represents only the part of the system that we choose to (or can) describe. In this sense, the unstated part is always non-deterministic (and non-reversible) in the sense that the state of the system does not determine its evolution. For example, suppose we define the state as position and momentum of the center of mass of a cannonball. Suppose that the evolution is deterministic on that state. What does it tell us about the cannonball temperature, or about the motion of each of its atoms? Nothing. In this sense, the unstated part is non-deterministic and non-reversible. Could we extend the state and the laws of evolution to account for temperature? Yes, but that would be a different evolution defined on a different state. Does it mean the unstated part is always evolving randomly? Not at all. The temperature may remain constant throughout the motion of the cannonball. Yet we wouldn’t know, since we are not studying it: the evolution is deterministic and/or reversible only as far as the state is concerned. With this in mind, we will restrict ourselves to the cases where the following is valid:
Assumption I** (Determinism and reversibility).**
The state of the physical system under study undergoes deterministic and reversible evolution.
Rationale. As it is an assumption, we first need to discuss when it is valid. More specifically, we need to understand that the non-deterministic/non-reversible evolution of the unstated part plays as much of a fundamental role as the deterministic/reversible evolution of the state. In fact, the non-deterministic part contributes in determining what states are available to the system.
Suppose we study the motion of a cannonball; its state under gravitational and (inertial) inertial forces will be properly described by the position and momentum of the center of mass. While light and air molecules may scatter off its surface unpredictably, its trajectory is not greatly affected as it is a massive rigid body. Suppose we study the motion of a small particle, small enough that the random scattering does influence the trajectory and it undergoes Brownian motion: its state will be a probability distribution for position and momentum of the center of mass. Gravitational and inertial forces have not changed, yet the states have changed from “pure” to statistical ensembles. In other words, the set of states must be closed under both the deterministic evolution of the state and the non-deterministic evolution of the unstated part. If the Brownian motion is not negligible, we do not end in a well defined position/momentum pair, even if we start from one.
A similar more drastic effect: consider a book and its motion under gravitation and inertial forces, its state being the position and momentum of the center of mass. As we increase the temperature of the air around the book, its motion remains unaffected until, at some point, the book burns. Clearly, the non-deterministic evolution has pushed one of the states outside the set of states, to the point that the system is no longer recognizable.
As we have hinted, sometimes the state is identified by a distribution (either statistical or actual). Even in this case, the state can be deterministic and reversible. That is, given the distribution at one time we can determine the distribution at future times. The shape and the parameters of the distribution can be deterministic, even if the evolution of the parts are not as they fall within the unstated part. Note that we cannot assume trajectories and states are always defined for the unstated part, as this includes also the unknown unknowns. We will return to this aspect when discussing quantum systems.
It should also be clear that what constitutes state and unstated part does not depend only on the system under study, but also on the processes we are considering. In some circumstances, the chemical composition of a fluid may be relevant, in others it may not. The choices of environment, state and unstated part are not independent from each other. By choosing a particular set of states, we are not only saying that the state evolution is well approximated by a deterministic/reversible map from initial to final state, but we are also saying that the non-deterministic/non-reversible evolution of the unstated part does not change the nature of the system, and processes that do not satisfy these conditions are not under consideration.
As with all assumptions, we should also ask whether it is necessary. That is, could we define a set of physically distinguishable states and yet have no deterministic and reversible processes defined on them? The claim is that this assumption is indeed needed, as without it we cannot properly define states or write useful physics laws. We can provide different arguments that point in the same direction.
First, to be able to identify the system, we must be able to tell it apart from anything else. Intuitively, we can distinguish between two chairs because we can move the first to another room and sit on it without having touched the second. We can manipulate the state of the first system without affecting the second, and vice-versa. So, to identify a system it has to be sufficiently isolated from everything else. This means that the system future and past states are with good approximation determined only by its own state: the state undergoes deterministic and reversible evolution.
Second, the aim of physics is to write laws that can be used to make predictions that can be validated experimentally. If I drop an anvil from a tower, it will accelerate at m/s2; if I want the anvil to reach the ground at m/s I have to drop it from m. To the extent that we want to make predictions in time, we need to have a correspondence between initial and final states.
Third, operationally we must reliably prepare and measure states. That is, we need a process for which the input settings of our preparing device determine the outgoing state of the system; and a process for which the incoming state of the system can be reconstructed by the output of the measuring device. That is, our system must, at least in some cases, be able to participate in a deterministic and reversible process with the preparing and measuring device. Without it we wouldn’t be able to calibrate our experimental apparatus.
Fourth, to be able to ascribe a property to a system we need to claim that, at least for a finite interval of time, the system either held or did not hold such property. That is, there is a deterministic and reversible process for that finite period of time for such property.
This link between state definition and deterministic processes should not be too surprising as the state, in the context of control theory and dynamical systems theory, is often defined as the set of variables needed to determine the future evolution of the system Katok ; Sontang . As we saw before, this applies also to statistical processes: the distribution (the ensemble) as a whole can indeed be calculated, measured and prepared. We can also describe the evolution of each element of the distribution provided that: we have a way to isolate it and study it under deterministic and reversible motion (so that we can define microstates); the non-deterministic motion does not alter the system (the set of microstates is preserved by the evolution).
As with many assumptions, we should stress that it’s an idealization: it can never be completely achieved in practice. A system can be prepared or measured up to a certain level of precision. Perfect determinism and isolation of a system is impossible both practically (e.g. black-body radiation, gravity, …) and conceptually (e.g. if the system is perfectly isolated, we cannot interact with it: how can it be physically distinguished?). It’s a simplifying assumption that can only be taken if the environment and the internal dynamics of the system interact in such a way that they little affect and are little affected by the aspect we are studying. As we saw before, for example, assuming that the state consists of the position and momentum of the center of mass requires assuming that the Brownian motion of the body is negligible.
Yet, this is a fundamental assumption in the sense that it is needed. If a particular set of states does not satisfy deterministic and reversible evolution under certain conditions, what we do is to keep at it until we find a set that does. That is, we work to restore the assumption. Finding new sets of states with new laws of evolution is, in fact, what leads to new physics. We therefore call fundamental model of physics the triad of state, unstated part and environment, with the assumption that the state may undergo deterministic and reversible evolution, and the unstated part undergoes non-deterministic non-reversible evolution that does not alter the set of states. ∎
IV States and state space
We now proceed to characterize states and physical distinguishability in more precise terms so that we can capture their description mathematically. What we’ll see is that the outcomes of all physical processes that can be used to gain information about the system, that can be used to perform a measurement, induce a topology on the set of states that is at least Hausdorff. That is, physical distinguishability is mathematically captured by topological distinguishability. Deterministic and reversible evolution will then preserve the topology, and they will be mathematically captured by self-homeomorphisms.
We’ll focus on state spaces that can be described by a set of independent state variables, either discrete or continuous, and see what can be said in general on the evolution of state variables.
IV.A States and topology
As the term “measurement” has become particularly loaded, let’s first characterize what we mean by physical distinguishability in our context.
Consider the motion of a cannonball under inertial and gravitational forces. Light will scatter off of it; as it lands, the ground will be deformed and the impact will make the temperature rise slightly. Those external physical processes, which happen no matter what we do, can be used to distinguish the motion of the cannonball as their outcomes are correlated. Therefore we can learn the position by looking at the reflected light, and learn the final kinetic energy by looking at the deformation of the ground. In principle, any external process that has a correlation with the states under study can be used to perform a measurement, and any measurement is based on such a process. That is, for us a measurement is simply a physical process that we can use to distinguish states. Setting up an experiment means choosing a particular process with desired outcomes and forcing the system under study to interact with it one or more times. After that, there is no special role played by the “observer” in making outcomes come about.
This external process may be quite complicated: when a particle enters a calorimeter, a shower of particles is produced, photons are captured and are directed to photomultipliers, a current is read out, the current is then digitized, and so on. Some processes interfere with the system, they affect its dynamics, and others are destructive, the system no longer can be described by the original set of states. A tracking chamber is an example of the first (the magnetic field curves the motion of a charged particle); burning a substance to determine its caloric content is an example of the latter. Therefore intimate knowledge of the process is always needed to ensure that one makes the proper link between outcomes and the original states, and properly accounts for systematic uncertainties that would skew that link.
Repeatability is also fundamental. First, to make sure the process is indeed correlated to the states. Second, because “a single take does not a measurement make.” One has to gather enough statistics. Note that the number of takes influences the outcomes: with greater statistics the precision and number of distinguishable cases increases. Therefore the processes, as we defined them, may require repeated interactions with similarly prepared states. They may even be a combination of different kinds of interactions that, taken all together, create a set of distinguishable outcomes. But in the end, however complicated it is, the conceptual model remains the same: each process has a set of possible outcomes, and each possible outcome will be associated with a set of states consistent with that outcome. For example, if the cannonball deformed the ground by this amount then its kinetic energy at impact was within this range; if the electron follows a certain path, then its state is among the ones that have spin .
Note that the outcome of the process (e.g. the electron followed a particular path) is conceptually distinct from the set of states compatible with it (the states associated with the path) and the way we label them (spin=). Yet, we’ll conflate the concepts as this makes the language closer to experimental physics (“the outcome of the measurement is spin=”). Context will allow us to recover the distinction.
However precise our measurements are, we can only gather a finite amount of statistics and each outcome is expressed by a finite set of digits; therefore, the set of outcomes is countable.444The information provided by the process as measured by Shannon’s entropy Shannon ; Jaynes is finite. Note that different outcomes for the same process can overlap. For example, cm and cm are both legitimate possible outputs of the same measurement device. But since all states must be distinguishable, given two arbitrary states there must be a process precise enough to tell them apart. That is, the potential outcomes associated with the two states do not overlap. For example, cm and cm do not overlap anymore.
We can also conceptually combine two different processes into a single one.555That is, take the logical and between outcomes of different processes. That is, having a way to measure quantity and a way to measure quantity gives us a way to measure the combination . For ensembles, if we can measure the marginal distribution and the marginal distribution , we know the joint distribution has to be compatible with both. Note, though, that this does not provide a way to fully measure as we know nothing about the correlation between the two variables.666The quantum case is similar: we measure marginal distributions and rule out states that are incompatible with them. Formally, the states compatible with the outcomes of the combined process will be the intersections of the states compatible with each pair of outcomes of the original processes.
We can also coarsen a single process.777That is, take the logical or between outcomes of the same process. That is, having a way to measure gives us a way to measure alone (or any ). Formally, the outcomes of the coarsened process are given by performing the union of some outcomes of the original process.
This model maps very naturally to a topological space. The states are elements of a set and the physical outcomes provide a topology on that set. The fact that two elements of the set can be distinguished requires the space to be Hausdorff.
Proposition IV.1**.**
The state space of a physical system is a Hausdorff topological space.
Justification. We claim is a set. Each state is well defined as it is physically distinguishable. The collection of all possible states forms a set.
We claim has a topology . Consider the set of all possible physical outcomes associated with all physical processes. Each possible outcome is associated with a set of states that are compatible with that outcome. Let be the set of all sets associated with all physical outcomes. and is associated with the outcome “the system exists.” and is associated with the outcome “the system doesn’t exist.” Let . Then, by definition, there exists a process that admits as an outcome and a process that admits as an outcome. Consider the process that combines the outcomes of and with a logical and. This always exists physically as we can prepare the same state multiple times and let it interact with each process separately. will have a possible outcome corresponding to the case where gave outcome and gave outcome . The states compatible with must be in both and , that is . Therefore is closed under intersection. Let . If they are physically distinguishable, then there exists a physical process that admits both as outcomes. Given , we can always construct the process that combines with a logical or into a single outcome , by “forgetting” which of the two was given. The states compatible with must be in either or , that is . Therefore is closed under union. is a topology by definition.
We claim that is Hausdorff. Let . As states are physically distinguishable, there must exist a physical process with two possible outcomes for which . is Hausdorff by definition. ∎
Note that the arguments that led to the topological space had nothing to do with states per se, just that they are physically distinguishable. States, though, are not the only objects with that property. In fact, any element of a set of physical objects (e.g. forces, physical properties such as mass or charge, time) needs to be physically distinguishable to be well defined. We can generalize the above justification: any set of physically distinguishable elements is a topological space.
Proposition IV.2**.**
Any set of physically distinguishable elements is a Hausdorff topological space.
Justification. Same justification as in IV.1 with “state” replaced by “element” of the set . ∎
With our state space defined, deterministic and reversible evolution corresponds to a bijective map between initial and final states. But that’s not enough. A physical process that can distinguish final states can be used, together with the evolution, to distinguish initial states. We prepare the initial state, let it evolve deterministically, measure the final state and use reversibility to convert the measure to one on the initial state. Therefore, not only the evolution is a bijection, but it also maps outcomes to outcomes. That is: the topology is mapped and preserved by the deterministic and reversible evolution because physical distinguishability must remain unchanged. The evolution is then a self-homeomorphism on the state space.
Proposition IV.3**.**
A deterministic and reversible evolution map is a self-homeomorphism on the state space .
Justification. We claim that exists. The system is deterministic: given an initial state there exists a well defined final state .
We claim is continuous. Let represent an outcome of a process on the final states. is an open set in the (final) state space topology by definition. Consider the process that first evolves the initial states and then distinguishes the final state with . is a process that distinguishes initial states. The set of initial states compatible with are . is an open set in the (initial) state space topology by definition. is a continuous map.
We claim that is a bijection. The system is reversible: there exists a map that returns the initial state given the final state. as mapping forward and then backward or backwards and then forward must return the original element. admits as an inverse. is a bijection.
We claim that is a self-homeomorphism as it is a continuous bijection. ∎
Again, we note that the arguments that lead to continuity had nothing to do with states per se, just that the relationship is between physically distinguishable objects. We can then generalize the above justification.
Proposition IV.4**.**
A map between two sets of physically distinguishable elements and is a continuous map.
Justification. Same justification for continuity as in IV.3 with “initial states” and “final states” replaced by “elements” of and respectively. ∎
The generality of this result explains why in physics one always assumes functions to be “well behaved.” As the result was derived from our notion of physical distinguishability, this is not a matter of practical convenience. Suppose we were able to prepare a force field that was zero everywhere in space except at a single point. This gives us a way to tag a specific point. But it also allows us to create an outcome compatible with only a single point. A finite precision measurement of the force provides us infinite precision of space, which we ruled out.888This assumes that we are able to position the probe perfectly, which we could do if we were able to manipulate forces at that precision. This is what the math is telling us, that if we claim that outcomes can’t distinguish isolated points (i.e. standard topology on ) then neither can maps. It is physical consistency that limits us to continuous functions.
While functions with few discontinuities are useful and used in physics and engineering, they are employed for idealized cases (e.g. a signal change is fast enough, a charge distribution is small enough) that are often treated as a special case (e.g. propagation across material discontinuities). While this may be obvious and intuitive to the physicist, it may be troubling to the mathematician as the proper use of many mathematical techniques requires the inclusion of discontinuous functions. This is less of a problem than it would seem at first. Once we made sure that the objects and their relationships are physically meaningful, we can extend our mathematical spaces for the purpose of math computations. Our physically meaningful continuous function can be expanded into a sum of discontinuous functions. One just has to be mindful of the extension and be wary that mathematical results that depend on such extension may or may not be physically meaningful.
IV.B Manifolds and labeling states
To identify and name states one uses a set of quantities, typically numbers. For example, the orbital of an electron in a hydrogen atom is identified by the quantum numbers , , and . We call each of these quantities state variables. We call a possibility a possible value that can be taken by a state variable. We call a state variable discrete or continuous if the possibilities are integer or real numbers respectively. The topology used reflects the notion that integers can be measured perfectly (i.e. discrete topology) while real numbers can be measured up to a finite precision (i.e. standard topology on ). From now on, we are going to consider state spaces whose states can be identified, at least within a region, by a finite set of discrete and continuous state variables (i.e. the state space is locally isomorphic to ).
We purposely use the term state variables instead of coordinates (even though that’s what they are mathematically) as it would create confusion with space-time coordinates. We also avoid the term observable or measurable, as not all state variables may be directly physically tangible (e.g. conjugate momentum in a gauge theory). The only requirement for state variables is that they identify states. This means the possible values for state variables are physically distinguishable and are defined at equal time (since states are defined and mapped at a particular time).999This is the main reason that a quantity like velocity is not a suitable state variable, as it is defined over an interval of time. Therefore velocity is always physically well defined but is not a state variable in general, while conjugate momentum is always a state variable but is not physically well defined by itself (it requires the vector potential to be specified as well). As we’ll see later, when there exists a one to one map between velocity and conjugate momentum they can both be physically well defined state variables.
Proposition IV.5**.**
A state variable is a continuous map where and is the space for the possible values. If the variable is said discrete. If the variable is said continuous.
Justification. We claim is a topological space. is a set of physically distinguishable possibilities. is a topological space because of IV.2.
We claim is a continuous map. is a map between two sets of physically distinguishable elements. is continuous because of IV.4. ∎
When combining multiple state variables, it is important to understand how they relate to each other. Consider the orbital of an electron in a hydrogen atom, which is identified by the quantum numbers , , and . For each combination of , and , the spin can have two values. The choice of spin is independent from the rest. The choice of , though, depends on the choice of : for only is available; for we can choose or . The choices are not independent. That is: two or more variables are independent if there always exists a state for any possible combination, if the total number of states is the product of the possibilities of each variable. We call state vector a collection of independent state variables that fully identify a state.
Proposition IV.6**.**
Two state variables and are said independent if such that .
In general, the entire state space may not be identified by a predetermined set of independent state variables. Consider the state of a pool table, determined by the number of balls together with position and momentum of the center of mass: the number of state variables is not fixed as it depends on the number of balls. But deterministic and reversible evolution cannot take us from a different number of continuous independent state variables (i.e. there is no homeomorphism between and ). That is the number of balls cannot change under deterministic and reversible evolution. Therefore we can restrict ourselves to the case where the number of continuous independent state variables is constant without loss of generality. This means that, at least locally, the state space is always homeomorphic to , and is therefore a manifold.
Discrete variables do not present such problems, as any number of them can be flattened out in a single one (i.e. is homeomorphic to ). They will determine the number of connected components of the state space. Once we introduce a continuous parameter for time evolution, though, these become irrelevant as continuous time evolution requires continuous trajectories that cannot move states across disconnected components. This justifies the special interest in path connected manifolds, as this is where trajectories for deterministic and reversible continuous evolution live.
Proposition IV.7**.**
Let a state within a state space. The set of states potentially reachable from by deterministic and reversible continuous evolution is a path connected manifold of dimension equal to the number of independent continuous state variables necessary to identify it.
Justification. We claim is a manifold. Let . Let be the number of independent continuous variables needed to identify . There exists a neighborhood around where we have . This map is a bijection as is identified by those variables. is homeomorphic to around . Let be the set of all states potentially reachable by deterministic and reversible evolution from . Deterministic and reversible evolution is a homeomorphism between initial and final states. there exist a map such that . and is isomorphic to . equipped with the subspace topology is a topological space everywhere homeomorphic to . is a manifold of dimension .
We claim is path connected. Let . There exist map where , and and are the initial and final time respectively. is a map between two physically distinguishable quantities, time and states. is continuous by IV.4. All are path connected to . is path connected. ∎
IV.C Evolution of state variables
To study time evolution, we need to describe how state variables change under deterministic and reversible evolution. There are two ways to do it, and we’ll need both. The first approach is to evolve the state variables from the initial value to the final value . The result is a trajectory which is especially useful when state variables correspond to physically meaningful quantities. For example, we track how the temperature or the pressure of an ideal gas changes. Evolved state variables, however, make it hard to find relationships that are invariant and common to all deterministic and reversible processes.
The second approach is to transport the state variables. The idea is to keep the connection to the initial state by labeling the future state by the original value of , instead of by the future values. For example, the evolved state variable will not tell us the current value of pressure, but the one for the initial conditions. So we introduce a new set of variables for which , which we can always do as the evolution is deterministic and reversible. The hypersurfaces at constant are the evolved hypersurfaces at constant of (e.g. all the states that started with a particular value for pressure) which allows us to study how groups of states evolve in time. Given that the value of the transported state variables does not change during evolution, and that it is unique for each initial state, transported state variables also provide a way to label the trajectories themselves.
Evolved state variables are useful to write equations of motion, study how physical quantities change, form a physical picture of what happens. Transported state variables are useful to write invariants, study state space trajectories, form a geometric picture for the state space.101010One should not confuse evolved/transported state variable with active/passive transformations or with Schroedinger/Heisenberg pictures. In those cases, the choice is between changing the state or the coordinates/observables. In our case, the state is always changing. The choice is between tracking the change with different values of the same state variable or different state variables that give the same value.
Proposition IV.8**.**
Let be a set of state variables and a deterministic and reversible evolution map. The evolved state variables are given by . The transported state variables are given by .
One reason that transported variables will be useful is that, during deterministic and reversible evolution, we need to make sure that the number of initial and final possibilities across independent state variables remains the same. This is more easily done using transported variables as the actual values do not change. In the discrete case, this is easy to show.
Proposition IV.9**.**
Let a set of states fully identified by a set of independent discrete state variables . Let the range of possibilities of each variable. Then and where and denotes the number of elements in the given set.
Justification. We claim . For each , let . We have . Therefore . .
We claim . As are independent variables, the states are the Cartesian product of the possibilities of each variable. ∎
What happens is that, because the variables are independent, the total number of states is the product of the number of possibilities for each variable. If and are ranges of possibilities for two independent variables, the total number of possibilities is . By construction, the set of possibilities for each independent variable is the same as the set of possibilities for the transported variable. Also, the transported variables remain independent. Therefore the relationship is valid throughout the evolution.
We’ll see that very similar relationships are what define Hamiltonian and Lagrangian mechanics. But recovering them in the continuous case is not as straightforward. Consider the map with . At first glance, it’s a bijective continuous map so we may think it can represent a deterministic and reversible evolution. Yet, : a set of states is mapped to a proper subset (i.e. to fewer states) which does not make sense for a reversible process. In the limit where we apply the map an infinite amount of times, any value of will be brought infinitely close to [math], which also does not sound like a reversible process.
The issue is that while deterministic evolution will map states to states, not all bijective state to state maps can be considered deterministic and reversible.111111In fact, we have already seen that the map must at least be continuous. This is a crucial point where this work is different from more usual treatments of dynamical systems. If one focuses only on the states themselves and counts them, it reaches the conclusion that a range of m contains the same number of initial conditions of Km: they have the same infinite number of elements. This conclusion has a number of problems: it does not match our physical intuition; it’s not consistent with all types of topology; it does not explain why the laws of evolution are very often, not only continuous, but differentiable. In short: a bijection does not capture the entirety of the physical description.
If we work with a discrete topology then, by all means, the way to measure the size of a set is to count the elements in a set. But if we use the standard topology on , isolated points have measure zero (i.e. we can’t physically distinguish them): what defines the number of initial conditions is the range of the state variables. As we’ll see, the geometrical structures in Hamiltonian/Lagrangian classical/quantum mechanics are there to allow us to properly count states and, more specifically, possibilities along independent state variables. If we think that counting states is equivalent to counting elements in the set, we miss the whole point of that geometrical structure.
What makes the matter even more confusing is that the single physical idea of counting states and possibilities along independent state variables does not map to a single mathematical concept. Sometimes we need a measure, sometimes we need a symplectic form and sometimes we need a metric tensor. It will depend, case by case, on the state space of the system under study. But, however defined mathematically, deterministic and reversible motion must preserve that count. This is the crucial insight that gives physical meaning to those structures, that justifies the use of differential equations for state evolution, that tells us why symplectic and Riemannian geometry are so important in physics. Properly characterizing this count will be one of the key goals of the following sections.
V Composite systems and reducibility
Given that scientific reductionism (i.e. the idea of reducing physical systems and interactions to the sum of their constituent parts in order to make them easier to study) is at the heart of fundamental physics Ruse , we now explore how to characterize a system in terms of its components. That is, we want to study the relationship between the state space of a composite system and the state space of its parts. In general, this is quite a complicated thing to do, which requires intimate knowledge of the system at hand. So we simplify our problem and study a material made of infinitesimal homogeneous parts. What we’ll find is that under the additional assumption that the material is infinitesimally reducible (i.e. its state is equivalent to the states of its infinitesimal parts) and that each part undergoes deterministic and reversible evolution, the motion is suitably described by the standard framework of classical Hamiltonian mechanics.
V.A Homogeneous decomposable systems and vector spaces
The notion that a system is decomposable means the states are equipped with a rule of composition that allows one to write : the composite system is the sum of its components. For example, the state of a ball is equal to the state of its top and bottom parts.
The notion that the system is homogeneous means that the states of the composite and of each part are not unrelated: they are all made of the same material.121212Whether a system is homogeneous depends on context (e.g. air can be thought as homogeneous if the mixture of gases does not change in space or in time due to phase transitions or chemical processes) and one must check that such a property is maintained by time evolution. In fact, the state space of all systems composed of such material will include the state of the system as well as the states of its parts (i.e. ). Since combining any two systems made of a homogeneous material will always give us a system made of the same homogeneous material (e.g. combining elements made of water gives us another element made of water), the state space is closed under composition.
As we study the system under evolution, we’ll also want to study state changes. For example, if a stable mixture of gas expands, we’ll want to know the difference between the initial and final distributions. That is: . Note that such a state difference may not describe a physical state: it may remove some material from one location to add it somewhere else. Yet, these state changes are still physically distinguishable objects that provide a configuration for the same homogeneous material, therefore we extend the state space to include state differences.131313Note that one can characterize a state difference without knowing the states themselves. If we take some amount of material out of a container we know how the state changed, yet we may not know the amount of material before or after. In certain cases one may be interested in measuring the asymmetry of a particular state without measuring (or without being able to measure) the full state itself. All combined, this gives us the structure of an abelian group.
Proposition V.1**.**
The state space for a decomposable homogeneous material is an additive abelian (i.e. commutative) group.
Justification. We claim is an additive monoid. There exists a law of composition that takes two states and returns one that is the physical composition of the two. The domain and codomain match because the material is homogeneous. The law is commutative and associative , as it does not matter in what order we physically compose the components. There exists a unique zero element and it represents the physically empty state (i.e. no amount of material). is an additive monoid by definition.
We claim is an additive group. We require to include state changes. A change of a physically distinguishable object is itself physically distinguishable therefore is still a Hausdorff topological manifold as per IV.2. There exists an inverse such that . is an additive group by definition. ∎
V.B Classical material and distributions
We also want to be able to express the state of the composite system in terms of the state of each part. For example, given the state of a fluid we’ll want to know how the material is distributed in space. This in general will depend on how much the state of the composite system “knows” about its parts. For example, the position and orientation of an ideal rigid body is enough to define where all its constituents are, while the volume/pressure/temperature of an ideal gas is not enough to determine the position and momentum of all its constituents. Therefore we need to characterize the system further.
We will call a particle the smallest amount of a material to which we can assign an independent state. For example, a photon is a particle of light (it is the smallest amount of light we can describe), an infinitesimal amount of water is treated classically as a point particle (the smallest amount for a continuous fluid).141414We use this definition as it allows us to retroactively talk on somewhat equal grounds about classical particles and quantum particles, and underscore how physically (and mathematically) they are very similar yet very different objects.
We will call a classical material one that is homogeneous and infinitesimally reducible. That is, we can keep decomposing the system indefinitely into smaller and smaller parts, each with a well defined state. In this case, the particles are the infinitesimal parts given by the limit of this process of recursive reduction. Giving the state of the whole system is equivalent to giving the states of all particles. Given the state space for the infinitesimal parts, which we assume consistently with IV.7 to be a manifold, a composite state will tell us the amount of material for each possible particle state. That is, each state is fully identified by a function that returns the amount of material in the composite state that is prepared in the particle state . For example, given a certain configuration of gas, we can tell the density of material that is at a specific point in space with a specific value of momentum.
The notion that the parts are infinitesimal requires the co-domain of to be a real number, as opposed to an integer. The state space could, instead, be a discrete set. For example, for a system composed of different tanks connected by pipes, the state of the composite system could be the overall distribution of water among the tanks. The amount in each tank is continuous (as we assume the water to be infinitesimally divisible) yet there are only a finite number of tanks the water can be placed into. As it links two physically distinguishable objects, is a continuous function as discussed in IV.4.
As we combine the states of different parts, we sum the distributions over particle states : the amount of material in the composite state is the sum of the amount of material of the parts. We can also increase or decrease the amount of material by a constant factor . This gives us the structure of a real vector space that is isomorphic to a subspace of continuous functions.
Proposition V.2**.**
The state space for a classical (i.e. homogeneous infinitesimally reducible) material is a vector space over isomorphic to a subspace of the space of continuous functions. That is is continuous, where is the state space of an infinitesimal amount of material.
Justification. We claim is an abelian group. is the state space for a decomposable homogeneous material and is therefore an abelian group by V.1.
We claim , the set of transformations that increase or decrease the amount of material in the system by a constant factor, is a field151515Here field is intended in the abstract algebraic sense (a nonzero commutative division ring) which has no relationship to the field in the physics or differential geometry sense (a physical quantity/tensor with a value for each point in space). isomorphic to . Consider the mapping between a number and the transformation that increases or decreases the amount of material by that factor. This transformation exists: the system is infinitesimally decomposable and the amount can be changed continuously. Define on an addition and a multiplication such that and , , so that the sum and product of the transformation is equal to the sum and product of their respective factors. is an isomorphism between and as fields.
We claim is a vector space over . The abelian group can be extended with the operations defined by , as each element is a map . The map has the following properties: and , increasing the amount of material by the sum of two constant factors is the same as combining the separate increases, and and , increasing the amount of the total system is the same as the combination of the increased parts. is a module over , which is a field and isomorphic to . is (isomorphic to) a real vector space.
We claim is isomorphic to a subspace of as a vector space over . returning the amount of material for each state . by IV.4. Let such that . As the system is reducible, two distinct composite states must represent different distributions. . is injective. is a bijection between and . Let , then as the amount of material of the composition of two states is the sum of the individual amounts. Let , then as increases the amount of material by the factor . is a homomorphism as a vector space. is isomorphic to . ∎
V.C Integration and measure
When the topology of is not discrete, the distribution is a density, which is not something we directly measure. What we do measure experimentally are finite amounts of material. For example, the amount of fluid in a particular volume within a particular range of momentum specified in some units (e.g. moles, kg, …). This means that given a composite state and a set of particle states compatible with an outcome of a process, we must be able to tell the amount of material that we will find associated with that outcome. That is for each open set there will be a functional .
As we combine parts, or increase the amount of material in each part, the total amount of material found will have to be consistent with those operations. That is: . For a proper state, one that is not the difference of two states, we will expect a positive amount of material. So, if a density is positive everywhere, then the total amount is also positive. This makes a positive linear functional. As the amount of material we measure is always finite, the functional applied to any composite state over any set will be finite.
The ability to associate finite amounts of material with sets of states allows us to define finite regions of and compare them. Consider a region of position and momentum in phase space. If we are able to spread a finite amount of material into a non-infinitesimal uniform distribution, then we know we have a finite region. And the density will give us an indication of how big the region is: if we double the region, the density will halve. In other words: because we are describing densities over , we are able to give a unique measure161616Here measure is intended in the mathematical sense (a real valued function of a -algebra) which is distinct from other connotations in physics. that allows us to count the number of states in each set of . In terms of said measure, positive linear functionals become integrals, .
This intuitive picture is formalized mathematically by the Riesz representation theorem for linear functionals Halmos , which gives the structure of a measure space, with a suitable Borel -algebra and measure .
Proposition V.3**.**
The state space for the particles of a classical material is endowed with a Borel measure . The state space for a classical material is isomorphic to a subspace of the space of Lebesgue integrable functions. That is .
Justification. We claim there exists a positive linear functional for each such that where is the interior of . Let be the functional that returns the amount of material in compatible with the outcome associated with the open set . is well-defined: is associated with a physically distinguishable outcome. is linear: as it has to be consistent with the operations of composing states and increasing/decreasing the amount of material by a factor. is positive: if the value of the distribution for each particle state is positive then the total amount of material is positive. Let not necessarily open. Define as .
We claim that . Let be an open set of particle states associated with an outcome. Let be a composite state. The amount of material of associated with the outcome must be finite, as physically we always work with finite quantities. . Let not necessarily open. .
We claim that . Let be open sets of particle states associated with two outcomes. Suppose , as the material found in must be either in or . Suppose , as the sum of the material associated with each outcome will double count the intersection. Let not necessarily open.
We claim that is endowed with a unique Borel measure such that . is locally compact as it is a manifold. therefore . is a family of positive linear functionals such that and . By the extension A.1 of the Riesz representation theorem for linear functionals there exists a unique Borel measure such that .
We claim is isomorphic to a subspace of as a vector space over . returning the amount of material for each state . As , then . by A.2. Let such that . is a homomorphism, as justified in V.2. is isomorphic to as a vector space. ∎
V.D Invariant densities and differentiability
On a state space with countable elements, using a single state variable, we have . We would expect the expression to become for states identified by a continuous state variable. By changing state variable, though, we see that this does not work in general: . For example, if we changed units from to , the value of the density would increase by a factor of . This makes a function not just of the state , but also of the state variables we are using. This is inconsistent with our previous definition. Moreover if the transformation is not differentiable, the density is not even well-defined. This tells us that cannot be any manifold: it has to be one that allows state-variable-independent densities.
The first order of business is to guarantee that the density remains defined under an arbitrary change of state variables. This means the Jacobian of the transformation must exist. For the Jacobian to exist the transformation between state variables has to be differentiable. Therefore a manifold that guarantees densities to be well defined is one that guarantees that state variable transformations are differentiable: a differentiable manifold. has a differential structure in the sense that the distributions and the volume element are only defined on a set of state variables that are linked by differentiable transformations. In the same way that discontinuous changes of state variable can be detected because they tamper with physical distinguishability (i.e. the topology), non differentiable changes of state variable can be detected because they tamper with our ability to define state-variable-independent densities and count states.
Moreover, the density itself has to be differentiable. The distribution is a real valued function of the state. As such, at least locally, we can use it as a state variable : we can identify particle states by the density of the material associated with them. This is more physically meaningful than one may first suspect, since placing physical markers (i.e. placing material at particular states) is a common way to define the references for a coordinate system. In a coordinate system where , the function is clearly differentiable as and for . As we change state variables, the transformation is differentiable, therefore all the derivatives exist. The density itself is differentiable.
Proposition V.4**.**
The state space for the particles of a classical material is a differentiable manifold. The state space for a classical material is isomorphic to the space of Lebesgue integrable differentiable functions. That is , where is differentiable.
Justification. We claim is a differentiable manifold. Let be the distribution associated with a composite state . Let and be two sets of independent state variables that fully identify states within . Let and be the expression in local coordinates of the distribution. as transforms as a density. . The Jacobian exists and is non-zero. The map between any two charts is differentiable. is a differentiable manifold.
We claim that the distributions associated with composite states are differentiable in the regions where they are strictly monotonic. Let be the distribution associated with state . Let be strictly monotonic in a region . Then its fibers in , the inverse images of the values, are connected hypersurfaces. We can construct a chart such that . The distribution is differentiable over for that variable: where is the Kronecker delta. Let be another set of state variables. is differentiable as the manifold is differentiable. is differentiable over .
We claim that the distributions associated with composite states are differentiable. Let be the distribution associated with state . Let be the distribution associated with state . Let be strictly monotonic in a region . Let where and . Let be sufficiently small so that is strictly monotonic over . and are differentiable over as they are strictly monotonic over . is a linear combination of differentiable functions over any arbitrary region . is differentiable.
We claim . Let be the distribution associated with a state . Let be a Lebesgue integrable continuous function. If then such that . Both integrals are finite as . Both integrals are expressible with the same state variables as all elements are defined on the same differential structure. Therefore there exists an outcome for that can physically distinguish the two distributions. There must be a state . is surjective. is a homomorphism, as justified in V.2. is an isomorphism between and as vector spaces. ∎
As we identified the space of Lebesgue integrable differentiable functions as the space of distributions that are physically meaningful, we can better understand why other commonly used function spaces do not fit the bill. Some are not restrictive enough. The set of Lebesgue integrable functions includes discontinuous functions that for IV.4 are unphysical. The space of continuous functions , the space of continuous functions that vanish at infinity and the space of differentiable functions include functions whose integral is infinite, which would represent an infinite amount of material. Some definitions are too restrictive. Requiring compact support (i.e. the function is different from zero only on a finite region) would exclude distributions, such as Gaussians, that span over the whole range of states. Such distributions are physical: if we take a finite volume of an ideal gas at equilibrium, the momentum distribution spans over the whole range. Schwartz space excludes functions that are not infinitely smooth which we don’t have a general physical justification for.171717One can, though, make the argument that given any distribution one can find an infinitely smooth such that the difference in description is small compared to the error already introduced by assuming the system to be homogeneous and infinitely reducible. The Whitney approximation theorem Lee makes this mathematically well defined.
Another consideration is that while the norm associated to is , the expression may be more physically meaningful in some cases. For proper states, the two are the same and they represent the total amount of material. For state changes they differ. The second represents the amount of material added (or taken away if negative) by the state change. For example, if is the change due to deterministic and reversible evolution, the amount of material does not change and therefore . The first norm would represent the total amount of material that is changing (i.e. being added and being removed), therefore means no material is moving, no change is occurring.
Note that neither of those expressions matches the norm given by the inner product defined as . Moreover , since it excludes discontinuous functions, can never be a complete normed space: it will not include the limit for all Cauchy sequences; it cannot be a Banach or a Hilbert space. Such a construction, though, is still useful. Consider the following expressions:
[TABLE]
For each state, they represent respectively the total amount of material, the material within , the density at , the total momentum and the average of a state variable. As they are linear functionals of , they can be expressed using their dual vector. But these vectors (, , …) are not elements of . They do not represent states, they are not continuous and integrable, and there is no single general physical meaning for all of them. Therefore, as we mentioned before, while we can extend the function space for convenience, computation purposes or to study a limit case, we need to be mindful of the extension and carefully check that the mathematical results are physically meaningful case by case.
V.E Invariant densities and cotangent bundle
Now that we are guaranteed that the density is properly defined for all state variables, we have to make sure it is invariant. The distribution should only depend on the states, and not the particular choice of state variables to label them.
If is to remain invariant under state variable changes, not only does the Jacobian have to exist but it must be unitary. This means we cannot simply change one state variable as we please. If we change one at least another has to change in some coordinated way such that the Jacobian of the total transformation is unitary. This means that we cannot change physical units of all the variables as we like: they are part of a unit system.
The simplest case is when a single variable is enough to define our units, and therefore tell how all the others must change. Suppose that our state space is identified by independent state variables and a change of units for the first, that is , determines the change for all others. The Jacobian matrix is the block matrix:
[TABLE]
The Jacobian has to be unitary, therefore all elements must be well defined and . As this can only happen if is a matrix, there can only be one . This gives and . As this is a change of units, we expect the zero value of to remain constant: . Therefore transforms as the component of a covariant vector. is isomorphic to , the space of co-vectors at a point, where is the manifold that defines our unit.
Physically, this means that the state variable , which is the classical analogue of the wave number, is expressed with the inverse of the unit used for . If is in meters, is in inverse meters. Consider now the area of an infinitesimal rectangular region. This quantity is dimensionless and therefore invariant. The total number of states will be proportional to it, as doubling the range of or will give us double the number of possible states. We have , where is the proportionality constant that will depend on the unit chosen to count the possibilities of the pair . That is, a unitary range of possibilities for and will give us possibilities.181818The actual value and physical dimensions of are determined by the system of units, and should not be taken to describe some intrinsic physical property. Only dimensionless relationships to other physical constants, such as the fine structure constant , can possess that trait. That is why one can choose “natural units” for which . In SI units the relationship between kinetic and conjugate momentum, derived later, sets the relationship between units. The state count in a finite (i.e. compact) region will be given by : we are finally able to write the volume of integration in terms of state variables.
We can generalize to the case where has more than one dimension. As we must be able to change one unit at a time, independently from the other, to each will correspond a that uses the inverse of the corresponding units. We have and . But it’s not just the volume, the state count, that is preserved as we change state variables. Each pair is expressed by an independent unit with the count of possibilities given by . We call such a pair a degree of freedom. As they are independent the total state count is the product of the possibilities of each d.o.f.: . In other words: independent d.o.f. are orthogonal surfaces in . The possibility count of an arbitrary degree of freedom, then, will be , the sum of the projections over the orthogonal and independent d.o.f. defined by .
The possibility count for each d.o.f. (i.e. the wedge product within a d.o.f.) and the orthogonality of different d.o.f. (i.e. the scalar product across d.o.f.) must be the same regardless of the choice of state variables. We can express both requirements mathematically in a compact way. We first define conjugate momentum as and unified state variables as . Then we consider the canonical symplectic two-form given by the following components:
[TABLE]
It returns the wedge product within a d.o.f. and the scalar product across. Requiring the invariance of this metric under state variable changes assures us the count of states and possibilities is well defined.
This gives us insight on the physical meaning of the geometrical structure . The canonical one-form represents the geometrical object we associate with each particle state. The symplectic form is the bilinear that quantifies the possibilities described by two given state variables. Note, instead, that the relationship , while mathematically true, has no clear physical meaning as we have not defined what the exterior derivative on a state actually represents.
We can capture the above discussion by stating that the state space is the symplectic manifold , where is the manifold that defines the unit system. This is the only manifold that allows us to define state-variable-invariant densities. The symplectic form allows us to count possibilities on an arbitrary d.o.f.
Proposition V.5**.**
The state space for the particles of a classical material is a symplectic manifold formed by a cotangent bundle equipped with the canonical two-form .
Justification. We claim the simplest (i.e. lowest dimension) state space that allows state-variable-invariant densities is the cotangent bundle of a single dimensional manifold . Consider a set of state variables for : the simplest unit system is one defined by a single state variable. Let be the state variable that defines the unit system. Let be the manifold charted by . A diffeomorphism fully defines a change of units. Let with be a set of state variables. The Jacobian determinant as densities must be invariant. . is one dimensional as its components must be fully specified by the previous relationship. Let . . as a change in units does not change the [math] value. . changes as the component of a co-vector. Each state is identified by a point and a co-vector in . The simplest state space is isomorphic to where is the one dimensional manifold that defines the units.
We claim the simplest state space that allows state-variable-invariant densities is the symplectic manifold where is the cotangent bundle of a one dimensional differentiable manifold and is the canonical two-form. Express integration in coordinates. . where is a constant, and is the canonical two form. is invariant under state variable change. is the symplectic form for . is a symplectic manifold.
We claim the state space for the particles of a homogeneous classical material is a symplectic manifold where is the cotangent bundle of an -dimensional differentiable manifold and is the canonical two-form. Let be a set of n continuous independent state variables that define the units necessary to describe a state in . Let be the manifold charted by . Locally . Changing units of one state variable must not change the units of the other as they are independent. State-variable-distribution can be defined separately on each degree of freedom. For each we have a covector . Locally . Integration must also be defined on an independent d.o.f. There must exist a non-degenerate two-form such that where is any two dimensional surface in . has to be form invariant under state variable change. The canonical two-form is the only such form. . is a symplectic manifold. ∎
It should be clear by now that the case of discrete topology is qualitatively different from the standard topology for . The notion that the continuous case is a limit of the discrete case, that it’s “like the discrete but with more points”, leads in this case to erroneous intuition. The key question is: can we physically distinguish an isolated state? Can we have an outcome associated with only one element? The answer is no with the standard topology on . The consequence is that when we define the measure for the count of continuous states, we assign a finite value to a finite region, and we assign zero measure to a single state. That is what gave us integration, densities and, ultimately, conjugate variables. If we were to use the discrete topology on , if we were to assume we can identify single states as we do for countable states, then we would assign measure one to each state and infinity to a finite region. We would not have integration, just a simple sum. Our distribution would not be a density and there would be no justification for conjugate variables. A finite distribution could only distribute a finite amount of material in a finite number of states.
In other words: this is not a case where a difference at small scales leads to a small difference at large scales. The two cases are radically different. We can tell them apart. We should take the use of densities and conjugate quantities as evidence that quantities like space and time are not discrete in the sense that the processes we use to distinguish those quantities cannot identify single instances. The quantum case does not change this, as the use of densities (in the form of the wave function) and conjugate quantities is even more prominent.191919If one wants to posit that space is fundamentally discrete at scales where both classical and quantum mechanics cease to be valid, the better strategy would be to work with a discrete version of and not by itself. Though it is not clear how a discrete topology would become non-discrete in the limit, at least the measure may be workable.
It should also be noted that classical particles, under this light, cannot be considered point-like. As they are the limit of infinitesimal subdivision, their spatial extent becomes infinitesimal but not zero.202020This picture is also compatible with general relativity, unlike point-like particles. These would not follow geodesics as their infinite mass density would significantly affect the gravitational field. But suppose particles were truly point-like. Then distinguishing particles would mean distinguishing points. We are back to the idea of a discrete topology on . In that case we would not have conjugate momentum, no , just the coordinates of the point in . This would actually be more self-consistent: why wouldn’t a point be enough to define the state of a point-like particle? As before, we should take the use of conjugate quantities as evidence that classical particles are really the limit of an infinitesimal subdivision.
Finally, we should note that we are in a position similar to the one discussed in IV.9 for discrete states. We have a topological space plus a measure that allows to count states and a symplectic form that allows to count possibilities, both expressible in terms of state variables. We recovered this structure starting from the idea of an infinitesimally reducible system. That led to a state space for the infinitesimal parts, on which we must be able to define state-variable-independent distributions, which in turn gave us degrees of freedom made by pairs of conjugate variables and the symplectic form typical of classical phase space. In short: being able to measure the amount of material is what allows us to count states.
V.F Infinitesimal reducibility
Now that we have fully characterized what we mean by a classical material, we can stipulate the following:
Assumption II** (Infinitesimal reducibility).**
The system under study is composed of an infinitesimally reducible homogeneous material and each part undergoes deterministic and reversible evolution.
Rationale. The idea is that time evolution specifies a map for the state space of each infinitesimal part. Knowing how the parts evolve tells us how a composite state evolves as well.
Consistent with what we said in assumption I, if we defined a state for each particle, then a deterministic and reversible evolution on that state must exist. Yet, the idea that we can assign states to infinitesimal parts should be considered only a simplifying assumption. The obvious reason is that we know this does not work in practice: as we keep decomposing the material we end up with molecules, atoms and then subatomic particles. But it is instructive to understand when and how the assumption breaks down at a more conceptual level.
The first problem is methodological. To be able to talk about the states of a part we need a physical process that is able to distinguish between them. For a billiard ball we can imagine marking one spot with a red marker. This allows us to track it as the ball moves or collides with other balls. For an electron, instead, we do not have a way to mark a piece. In fact when two electrons scatter we can’t even tell which is which, let alone what portion went where. The classical assumption may not hold because we do not have suitable physical processes at our disposal.
Even if we are able to track parts, the assumption requires them to be infinitesimal, the limit of a process of infinite recursive subdivision. The best we can do experimentally is to confirm that the assumption holds up to the smallest precision available. Therefore even in the best of cases it cannot be considered an experimentally validated assumption but a reasonable default assumption (e.g. “it worked so far”).
The second, more conceptual, problem is that the idealizations that allowed us to define states in assumption I may not hold as the parts get smaller. Recall the cannonball whose motion is sufficiently unaffected by the photons that scatter off its surface. As we consider smaller and smaller parts, at some point we will find an amount of material that is affected by the interaction with the air or photons scattering off of it. At that point the parts are no longer sufficiently isolated to define an independent state, their evolution depends on the environment. Therefore the deterministic evolution of the whole cannot be reduced to the deterministic evolution of its parts.
Another issue is that defining a state requires some kind of asymmetry between system under study and environment. The future state of the system does not depend on the state of the environment, so that we can define an independent state, yet the future state of the environment is affected by the state of the system, so that we can have external processes that allow us to define physical distinguishability. If we try to assume that both the system and environment are really made of the same classical material, then the claim to that asymmetry is lost: the infinitesimal parts of both system and environment must affect one another in the same way.
Another issue arises if we include the measuring device in our description. Ideally, we’d like to require the following:
- •
The system under study is deterministic and reversible
- •
The measuring device ascertains the state of the system
- •
System and measuring device, as a whole, is deterministic and reversible
Unfortunately, these three requirements together are inconsistent. Say is the initial state of our system and the initial state of our measuring device: the final state because the system is deterministic; because we are able to know the initial state of the system by looking at the final state of the measuring device; because the system as a whole is reversible. Since is determined by , and can be known from , can be determined from just . But since , the whole past state could be reconstructed just by looking at the future state of the measuring device. But cannot be an injection, therefore we arrive at a contradiction.
Of those three requirements we can only pick two. If we want determinism and reversibility for the combined system, either both systems are not independently deterministic or the second is not a measuring device. In other words: we can’t expect to have deterministic and reversible evolution at all levels of aggregation and have the parts interact in any physically meaningful way.
The same problem of physically meaningless interaction surfaces when we consider the states of infinitesimal parts. Under our classical assumption, if we were to take the state of an infinitesimal part to really be its full description, with no unstated part, then each piece would evolve independently, oblivious to the other parts. Each particle would essentially reside in its own separate physical universe, as it cannot physically distinguish anything else. This is not physically meaningful.
If we assumed the system is deterministic and reversible only as a whole, then each part could evolve depending on the states of the other parts. This would seem much better, as the state of the pieces is still exhaustive yet they are physically connected to each other. But this does not actually solve the problem of independent oblivious components. First, for this to work, one would have to specify how the states of the parts were defined since their evolution is individually no longer deterministic (the future of each part depends on the state of other parts). But ignoring that issue, the bigger problem is that we can always locally separate the evolution into independent degrees of freedom. For example, the position and momentum of two particles may affect each other during the evolution, but the average and difference in position and momentum may evolve independently.212121Also note that any Hamiltonian is locally isomorphic to a free particle Linares We can always find such a local decomposition, and the easiest way to see that is in terms of the transported variables: they retain the original value; they clearly evolve independently. And since the pieces are infinitesimal, a local decomposition is all that is needed. While such description may be cumbersome to achieve in practice, conceptually it is still possible. So, even if each particle evolution depends on the state of the others, the system is described by degrees of freedom that evolve independently, oblivious to each other.
The moral is that the classical idea of being able to assign to all systems a state which represents their full description does not work. The state is only what we can describe and it can’t be the full description. As the division between system and environment is subjective, each system must be able to function as both. Therefore it will have a part whose evolution depends only on the system itself, the state, and a part whose evolution depends on other systems, the unstated part. While they may not be the same in all circumstances, they must exist. The state is what gives the identity to the system, the part we can study and describe. The unstated part is what allows continuous interaction between the system and the environment; it’s what allows us to study and describe the state. As we’ll see later, it is precisely this problem that quantum mechanics conceptually addresses better than classical mechanics.
One final problem is with time itself: an infinitesimally reducible system undergoing deterministic and reversible evolution cannot tell time. If it did, we would be able to find a quantity that changes through time but is invariant under state variable changes. The problem is that deterministic and reversible time evolution is equivalent to a state variable change. In fact, at a fixed time, we can choose to describe the system with the transported state variables of any past or future times. So, all quantities that are invariant under state variable changes are also invariant under time evolution. The somewhat ironic result is that while time is essential for the very definition of deterministic and reversible evolution, time itself has to be defined by some other type of process.222222For example, if the phase-space volume occupied by a distribution increased, it would give us a coordinate-invariant quantity that changes in time. This, however, is not possible under Hamiltonian evolution.
In light of what we discussed, we cannot take the classical assumption to be fundamental, in the sense that we cannot take it to strictly apply to all of the universe. While ultimately flawed, the assumption can be considered valid for a great number of macroscopic systems, and is also useful as a default assumption of sorts. Understanding its shortcomings will help us later to see how the quantum assumption solves, at least partially, some of these issues.
As a final note: we caution against automatically thinking that the classical assumption is valid for all macroscopic systems. It is conceptually possible to have a macroscopic system where a clear independent state cannot be assigned to each part, in which case the assumption would not hold.232323For example, this is the case in Bose-Einstein condensates BEC . ∎
V.G Hamiltonian mechanics
We are finally ready to write the equations of motion. As per IV.3 our evolution is at least a self-homeomorphism . But this is not enough.
The evolution must map the distribution point-wise so that the value associated at the initial state is the same as the value at the final state. All the material that starts in has to end up in . In math terms .
In the same way we expect the total amount of material to be conserved. If is a set of initial particle states and is the amount of material associated with that set, then we expect it to be equal to the amount of material associated with the set of final states .
But probably the easiest way to look at it is that initial and final sets of states have to possess the same count of states and possibilities as defined by the symplectic form . Therefore the area within a degree of freedom, which represents the number of possibilities in said d.o.f., needs to be mapped to an equal area within the transported d.o.f. (i.e. the d.o.f. defined by the transported state variables). Independent d.o.f. must remain independent, and therefore transported orthogonal d.o.f. remain orthogonal. This means that the product of possibilities of independent d.o.f. is also conserved. These statements are the physical justification of Gromov’s non-squeezing theorem Gromov ; deGosson ; Stewart and Liouville’s theorem. And they give intuitive insight on the geometry of Hamiltonian systems.
Mathematically, under the classical Hamiltonian assumption, deterministic and reversible evolution is a self-symplectomorphism (or self-isometry or canonical transformation depending on your math training). That is, it does not just preserve the topology but also the symplectic form .
Proposition V.6**.**
A deterministic and reversible evolution map for the particles of a classical material is a self-symplectomorphism. That is: and where is the pullback of .
Justification. We claim is a self-homeomorphism on . The state space for the particles of a classical material is by V.5. is a deterministic and reversible evolution map and by IV.3 is a self-homeomorphism.
We claim is a symplectomorphism on . The distribution on final states must be defined therefore the Jacobian for exists and is non-zero: is a diffeomorphism. A deterministic and reversible process conserves the number of states and possibilities. is the two-form that returns the count of possibilities. is invariant under deterministic and reversible evolution. is a symplectomorphism by definition. ∎
If we assume continuous time evolution we have the following:
Proposition V.7**.**
A continuous deterministic and reversible evolution for the particles of a classical material admits a Hamiltonian that allows us to write the laws of evolution as
[TABLE]
Justification. We claim the vector field for the infinitesimal displacement admits a potential such that . The state space for the particles of a classical material is a symplectic manifold by V.5. The map for infinitesimal time evolution is an infinitesimal self-symplectomorphism by V.6. By A.3 the infinitesimal displacement admits a potential such that
We claim the state variables evolve according to Hamilton’s equations. . For we have . For we have . ∎
We recognize the familiar set of Hamilton’s equations. They are the set of equations that describe the deterministic and reversible motion of the infinitesimal parts of an infinitesimally reducible homogeneous material. Note that the argument goes the other way as well. A system governed by Hamilton’s equations is deterministic and reversible: the equation of motion given by are differentiable since is twice differentiable. Therefore the equations are Lipschitz continuous and, by the Picard-Lindelöf theorem, a unique solution exists Grant .
In other words: the forces that conserve energy (i.e. the value of a suitable Hamiltonian) are exactly the ones that provide deterministic and reversible motion. The challenge in their derivation mainly lies in the necessary use of different branches of mathematics (e.g. topology, measure theory, differential geometry, symplectic geometry). The conceptual meaning, on the other hand, is hopefully straightforward.
It’s important to realize that, during the derivation, multiple mathematical features (e.g. invariant densities, cotangent bundle for phase space, symplectomorphism) were justified by the same physical assumption. The math itself gives us no indication that the different features stem from the same source; therefore, the math itself does not give us a conceptually unified picture. This is one of the reasons we believe that starting from the physical description is objectively better if we are to come to a better understanding of our physical theories.
Note that we could have taken different approaches. For example, we could have appealed to information theory and required our invariant distributions to preserve Shannon’s information entropy Shannon , as no information should be gained or lost during a deterministic and reversible process. Or we could have appealed to statistical mechanics and required that the determinant of the covariance matrix be conserved, as a deterministic and reversible process should be defined at the same level of precision. With suitable treatment of independent d.o.f. both these approaches recover Hamiltonian mechanics as well. While the full treatment is outside the scope of this work, we want to underline that the definitions used in this work go a long way to building bridges at the core of different mathematical and scientific branches.
VI Time dependent evolution
We now generalize our discussion to include time dependent dynamics. This is needed when the evolution map is not the same at all instants or when state variables depend on time (e.g. changing to a moving frame).
To do this we will redefine the particle state space to include the temporal degree of freedom. We’ll find that the dynamics is described by relativistic Hamiltonian mechanics in the extended phase space. We’ll also find that particle states divide into standard and anti-states depending whether time is aligned or anti-aligned with the evolution parameter. Note that no extra assumption is needed, which makes relativistic mechanics simply the correct time dependent description of the deterministic and reversible evolution of an infinitesimally reducible system.
VI.A Time changes
The discussion so far has been limited to the case where both the state variables and the evolution map never change throughout the evolution. This is too restrictive as there are very reasonable situations in which this does not hold.
The first obvious case is that the map may be time dependent. This does not affect our definition of determinism and reversibility as we still can tell final state from initial state and vice-versa. But at this point we have no way to specify a time dependent evolution: the Hamiltonian as we derived it is just a function of the state.
The second case is when we perform a transformation for the time parameter . The equations of motion transform and we have . and are real functions of the state space and cannot be redefined to include . Physically the transformation is introducing fictitious forces that are not conservative, so they cannot be expressed by a Hamiltonian. But this means that we have an ill defined mathematical framework as the notion of determinism and reversibility is not defined in a way that is independent of time transformations. We need a framework that is capable of handling the fictitious forces as well.
The third case is when we perform a state variable transformation that is time dependent (e.g. ). Our composite state distribution becomes : it is no longer defined at equal time. This means that our measure needs to be modified to define integrals over the time variable.
As we can see, the framework we have is ill suited to handle these cases. Therefore we cannot simply stick time in the Hamiltonian and expect everything to work out. But we can’t ignore the problem either as the three cases outlined are common situations to study. So we need to go back to our definitions and amend them properly.
VI.B Complete state space
The first thing to do is to amend our definition of state space to include all states at all times. It may seem like we are extending our definition of state and state space but, at a closer look, we are not. Since we defined state as a physical configuration at a particular time, the set of all states (i.e. the state space) is more accurately defined as the set of all configurations at all times. In the previous sections we tacitly simplified the problem by ignoring time, which made it easier to study the time independent case. This approach is common in physics and engineering, which is why it fits the standard names, but this is also the source of the above problems.
We’ll therefore call complete state space of particle states the set of all configurations at all times and we’ll indicate it by . In that space, a state will be given by , making a dimensional manifold. A region at equal time will be a hypersurface that includes all possible configurations at a particular time. Such hypersurface will need to cut across all evolutions once and only once, therefore not all functions are suitable time variables. A time evolution is a line that passes once through each equal time surface. Specifying an evolution map means giving a set of lines such that each state is traversed once and only once.
Proposition VI.1**.**
The complete state space for the particles of a classical material is a dimensional differentiable manifold. The state space at a particular time is a hypersurface of .
Justification. We claim is a dimensional differentiable manifold. Locally there exists such that as a state exists for each configuration and each time instant. Locally . is a dimensional manifold. is a differentiable manifold. Time evolution is a diffeomorphism by V.6 therefore derivatives between state variables and time variables always exist. is a differentiable manifold.
We claim is a hypersurface of . Let be a time variable. is a level set. is monotonic as it is a time variable. has no critical points. is a regular value. is an embedded submanifold of co-dimension . is a hypersurface. ∎
For the composite state we need to take a different approach. A distribution of material over states at equal time will depend on the choice of time variable, therefore the complete state space will not be useful as it will not be time invariant. What we are really interested in is the state evolution space of a classical material, which we’ll indicate by . To each state evolution will correspond a distribution over all particle states at all times. This distribution will be differentiable: it’s differentiable over all equal time hypersurfaces and time evolution is differentiable. The distribution, though, is not integrable over the complete state space . Such integration will operate over time as well, giving the amount of material multiplied by time. If time is taken to be infinite the value is not finite. The distribution, instead, must be integrable over all equal time hypersurfaces: no matter what time variable we choose, the amount of material found at a particular time has to be finite.
Proposition VI.2**.**
The state evolution space for a classical material is isomorphic to the space of differentiable functions that are Lebesgue integrable on any equal time hypersurface. That is where .
Justification. We claim . Let be the distribution of material associated with an evolution . Let be a time variable. The restriction of over an arbitrary level set is continuous and integrable by V.4. . Time evolution is a diffeomorphism by V.7. is differentiable along the time variable as well as the state variables. .
We claim . As in V.4, if two distributions are different there exists an outcome that can tell them apart, therefore they represent two distinct physical evolutions. ∎
Before proceeding, it’s useful to get a better intuition for the geometry of these spaces. Note that the transported state variables are perfect to label the particle state evolution : as they do not change during the evolution we can take them to label not just the values at a particular time, but the evolutions themselves. The distribution is transported deterministically and reversibly over those lines, so the value of the distribution will be constant along each particle state evolution . To identify the full evolution, then, we just need to specify the distribution only on a region that cuts across all particle evolutions, i.e. a hypersurface at constant time.
VI.C Relativistic cotangent bundle
We now want to extend the symplectic form so we can count states and possibilities over the complete state space . The first thing to do is to complete our -dimensional , the manifold that defines our units, to include the time variable . This, again, highlights our previous oversight: we didn’t include time within the quantities needed to specify a physical configuration at a particular time. We call such a space which is a manifold of dimension : state variables and the time variable are independent (i.e. any combination of state and time variables is valid).
As we said before, the time variable is not simply another state variable: it doesn’t identify extra configurations and it’s the variable on which we have defined deterministic and reversible evolution. When changing variables, we still need to make sure that deterministic and reversible motion can be defined on the new time variable. Transformations like (exchanging time with another state variable) or (polar coordinates between time and state variable) clearly do not guarantee deterministic and reversible motion over the new time variable. To be meaningful, the change of time variable must preserve time ordering therefore the transformation has to be strictly monotonic between the two time variables. On the other hand, the change of state variables must preserve the ability to uniquely identify states at each instant in time. In this sense, time is not just like another state variable.242424In relativity, for example, it is common to use foliations and the formalism to recover the special character of time when performing calculations or to gain better physical insight Gourgoulhon .
As in the time independent case, we are interested in invariant densities which are defined on co-vectors. The co-vector is completed with a time component .252525 is the classical analogue of the wave frequency. We use to distinguish from the symplectic form . As each state variable has a conjugate quantity , the time variable will have a conjugate quantity . We call the combination of the temporal degree of freedom. As time is special, so is the temporal degree of freedom, which is treated differently when defining a distribution and therefore by the measure and the symplectic form .
Most of all, the temporal degree of freedom is not an independent degree of freedom because cannot be an independent variable. It cannot add any configurations, as those are defined by only, and cannot add any time instants, as those are defined by alone. Therefore there must exist a constraint such that, locally, . The complete state space is a hypersurface of .
As the temporal degree of freedom is not independent of the other d.o.f. ; it is not orthogonal to them in . States are defined on the plane where (maximally) change. This is not the plane of constant (they are not orthogonal) where the area given by is defined. It is the plane perpendicular to constant . And the plane of constant is where the area given by is defined. That is: the plane where we can properly count states and define our symplectic form is perpendicular to . Intuitively, states are defined independently of time, therefore they are defined on a surface perpendicular to the temporal d.o.f.
We have a right triangle-like relationship between the plane where is defined and its projections on the planes defined by each d.o.f., similar to the multiple d.o.f.:
[TABLE]
But in the previous case, the right angle was between the two independent d.o.f. In this case, the right angle is between and the plane of constant where is defined. We rewrite it as . This corresponds to the Minkowski product across d.o.f. and the vector product within. In terms of unified state variables we have:
[TABLE]
The symplectic form is still the canonical two-form expressed with the mathematically non-canonical, but physically meaningful, variable . This allows us to better understand its physical meaning. allows us to count the possibilities within a degree of freedom, adjusting it on to avoid the counting problems introduced by time variable changes.
The symplectic form also allows us to distinguish temporal from standard d.o.f. Given a two-dimensional surface , how can we tell if it should be charted by a or whether we can define a distribution on it? Consider . The result will be positive if the integration is over a standard degree of freedom, and it will be negative if the integration is over the temporal degree of freedom. If the contribution in every subregion of is positive, then the whole is always oriented along a standard degree of freedom.
The invariance of also prevents mixing between standard and temporal d.o.f. The Euclidean signature across standard d.o.f. allows us to move ranges of possibilities from one d.o.f. to the other while conserving the total: the generators of rotation are in fact divergence free. The Minkowski signature, instead, only allows hyperbolic rotation (i.e. Lorentz boosts) across standard and temporal d.o.f., whose generators are curl free. Therefore, as required, we cannot transform a distribution over a standard d.o.f. into a distribution over a temporal one.
We can capture the above discussion by stating that the complete state space is a hypersurface of the symplectic manifold , where . And if we set and , we can write . This is the manifold that allows us to define time-and-state-variable-invariant densities. The symplectic form allows us to measure the count of possibilities as in the time independent case.
Proposition VI.3**.**
The complete state space for the particles of a classical material is a hypersurface of the symplectic manifold formed by a cotangent bundle equipped with the canonical two-form .
Justification. We claim the space of physical objects that allows time-and-state-variable-invariant densities is a symplectic manifold where . Let be the manifold that defines the unit system including time. Locally as time and state variables are independent quantities. As in V.5, invariant densities are defined on the symplectic manifold . Let be the co-vector component associated with . Let . Let be the symplectic form. The components of across different d.o.f. must be zero as they are not invariant under change of units. . The case is excluded as the temporal degree is not an independent d.o.f.: .
We claim is a hypersurface of . as states are physical objects that allow time-and-state-variable-invariant densities. Consider the map . is an open map. The topology of is the subspace topology. Let be an invariant density. is differentiable by V.4. Its restriction on is also an invariant distribution and therefore differentiable. The inclusion map is a smooth embedding. is an embedded submanifold of co-dimension . is a hypersurface. ∎
VI.D Relativistic Hamiltonian mechanics
As we are using time as a variable to label states, we will use a different quantity as the parameter for the evolution. The trajectory of a particle in the extended phase space will be given by the evolved variables in terms of a parameter . As before, deterministic and reversible evolution will preserve , as the possibility count on each independent d.o.f. will be conserved. Mathematically, deterministic and reversible evolution is a self-symplectomorphism.
Proposition VI.4**.**
A time-dependent deterministic and reversible evolution map for the particles of a classical material is a self-symplectomorphism on . That is: such that where is the pullback of .
Justification. We claim is a self-homeomorphism on . The complete state space for particles of a classical material is by VI.3. is a deterministic and reversible evolution map and by IV.3 is a self-homeomorphism. We can extend the map over .
We claim is a symplectomorphism on . The distribution on final states must be defined. The Jacobian for exists and is non-zero. is a diffeomorphism. A deterministic and reversible process conserves the number of states and possibilities. is the two-form that returns the count of possibilities. is invariant under deterministic and reversible evolution. is a symplectomorphism by definition. ∎
If we assume continuous time evolution we have the following:
Proposition VI.5**.**
A continuous time-dependent deterministic and reversible process for the particles of a classical material admits an invariant Hamiltonian that allows us to write the laws of evolution as
[TABLE]
Justification. We claim the vector field for the infinitesimal displacement admits a potential such that . The map for infinitesimal evolution is an infinitesimal self-symplectomorphism by VI.4. By A.3 the infinitesimal displacement admits a potential such that
We claim the state variables evolve according to the extended Hamilton equations. . For we have . For we have . For we have . For we have . ∎
We recognize the equations as those for Hamiltonian mechanics on the extended phase space Synge ; Lanczos ; Struckmeier .
The trajectory in time is of particular importance. Since the evolution is deterministic and reversible, for each value of we need to have one and only one value of . Therefore is invertible, strictly monotonic and along a trajectory cannot change sign. This means there are two classes of states: the ones where the parametrization is aligned with time , which we call standard states, and the ones where the parametrization is anti-aligned with time , which we call anti-states. Let us call the function that returns the change of along . for all standard states while for all anti-states. Note that since the parametrization is conventional and can be changed to , what we call standard and anti-states is also conventional. What is physical and not conventional, though, is that standard and anti-states cannot be connected by deterministic and reversible evolution.262626This represents the classical analogue for quantum anti-particle states.
Proposition VI.6**.**
Let be the time dependent deterministic and reversible evolution map for the particles of a classical material. The map partitions the extended state space into standard states, those connected by a trajectory where , and anti-states, those connected by a trajectory where .
Justification. We claim is strictly monotonic. The motion is deterministic and reversible. At each value of there must be only one possible state: if there is more than one state the motion is non-deterministic (one state is not enough to identify more than one state), if there is no state the motion is non-reversible (no state cannot identify a state). is invertible. is strictly monotonic.
We claim partitions the space. Let be two physical states connected by deterministic and reversible evolution. . Let and . . Let the trajectory given by deterministic and reversible evolution, where is the range of the parametrization. Either or . ∎
With the invariant Hamiltonian we are able to write the equations of motion for any choice of time and state variables. For example: . These equations must be the same as the ones given by a standard Hamiltonian in those coordinates. That is: . The partial derivatives of and are related, and therefore the functions themselves are related. Working through the math, we find that the most general relationship is of the form: where , is an arbitrary function and, most importantly, .
The arbitrary function has no physical consequence: it is just a constant added to the Hamiltonian. We can either set it to zero or simply redefine the Hamiltonian to include it. Therefore we are left with . In other words: is the value of the Hamiltonian, the energy of the system. We have found the constraint that identifies the hypersuface of introduced in VI.3.
Note that for all states , since and . For all states we also have . Therefore only because . We can extend on all of such that outside of the complete state space . This way we can directly use the constraint to identify as a subspace of .
This way gives both the constraint to identify states and the map to identify their evolution.
Proposition VI.7**.**
The form of the invariant Hamiltonian is given by where is the standard Hamiltonian at each instant , the conjugate time variable represents the value of the Hamiltonian, and where . is the level set for .
Justification. We claim the form of the extended Hamiltonian is . Let be the invariant Hamiltonian and be the Hamiltonian for a particular choice of time and state variables. We have where such that . . As for all physical states, we can set without loss of generality. We have . This holds for all choices of . In particular for , . . is not a function of . Repeat the same procedure for . is not a function of . . In particular for , . . is not a function of . is only a function of . We can redefine as the result is still a function of with the same equations of motion. .
We claim for physical states. regardless of the choice of t and therefore for all . .
We claim is the level set for . over . We can extend over such that over . is the level set for . ∎
As an example, the Hamiltonian and invariant Hamiltonian for a relativistic free particle are:
[TABLE]
Therefore we can see that the invariant Hamiltonian has the form . In the next section we’ll derive the above expression and look more closely at the case of particles under potential forces.
Now that we have characterized the motion of the particles, we should also characterize the evolution of composite states.
Suppose we have a distribution of material associated with an evolution . Its support, the region where the density is non-zero, is within . Therefore since in where . As the density is transported over each trajectory, its value does not change over . Therefore we have where is the Poisson bracket.
Proposition VI.9**.**
Let be the distribution of material associated with the evolution . and .
Justification. We claim . Let be the distribution associated with an evolution . as the distribution is defined on the complete state space of the particles. by VI.7. .
We claim . . Let be a parametrization for a particle evolution . Then as the material does not change over the particle evolution. . ∎
As we have derived relativistic motion in an unusual way, a few comments are in order.
As mentioned at the beginning of the section, no new assumption was required. Relativistic Hamiltonian mechanics is simply the correct way of handling time dependent motion. As such, there was no mention of the speed of light , being a pseudo-Riemannian manifold or its metric . These will be introduced in the next section with the kinematic equivalence assumption. In light of this, it is probably better to consider relativistic mechanics as a feature of the geometry of the complete state space more than the geometry of space-time. Also note that this feature arises from the use of the standard topology on and the need for invariant densities. It would not have arisen with the use of a discrete topology.
We have also seen that anti-particle states, generally associated with quantum field theory, are actually a feature of relativistic Hamiltonian mechanics. This is usually missed because in classical mechanics only the standard Hamiltonian is typically used. Note how the invariant Hamiltonian in VI.8 is quadratic in , which can have both positive and negative solutions given the constraint .
Another important feature is that this formulation of relativistic Hamiltonian mechanics is formally very close to the quantum case. Note how and are formally equivalent. If we apply to the invariant Hamiltonian in VI.8 the usual formal classical/quantum substitution, we have the Klein-Gordon equation using space-like convention rescaled by a factor of . As we’ll see later, to this parallel in the mathematical formalism corresponds a parallel in the physical description.
As a final thought, we note how the physics maps less elegantly to the math in the time dependent case. The function space for is not simply the Lebesgue integrable differentiable functions, but those that are integrable on particular hypersurfaces. The complete state space is a hypersurface of . The invariant Hamiltonian is needed to identify that subspace. This may be a hint that a better formulation is lurking, one where we consider the particle evolutions as the primary objects and label those (instead of the states). The distribution of material would simply be a distribution over the particle evolutions, a Lebesgue integrable differentiable function. Yet, the need to be able to describe the evolution in terms of physically meaningful state variables will most likely reimpose the extra structure.
VII Kinematics and minimal materials
We will now focus our attention on the simplest possible classical material: one that is fully described by its motion in space, i.e. the internal dynamics can be ignored. What we’ll find is that the dynamics of its infinitesimal parts follows classical Lagrangian mechanics. Furthermore, the Hamiltonian of the system is constrained to the one of a free particle under scalar and vector potential forces.
VII.A Kinematic equivalence
The link between kinematics, the study of motion through quantities like velocity and acceleration, and dynamics, the study of state evolution and its causes, is crucial in physics. In Newtonian physics, provides such a link. In Hamiltonian (and Lagrangian) mechanics, the link is implicitly given by the choice of the Hamiltonian (or Lagrangian).
Our aim is to make that link more conceptually crisp and explicit with the following assumption:
Assumption III** (Kinematic equivalence).**
For the system under investigation, studying its kinematics (i.e. trajectories in space) is equivalent to studying its dynamics (i.e. states and their evolution).
Rationale. The idea is that the system internal dynamics has no effect on the overall motion and therefore can be disregarded. Consider the motion of our cannonball under gravitational and inertial forces: its temperature or precise chemical composition does not affect the overall trajectory. We can assume kinematic equivalence. Suppose we now add magnetic forces to our consideration. The magnetization of the cannonball may now affect the motion and therefore we cannot always reconstruct the full state by simply looking at the trajectory. We cannot assume kinematic equivalence.
Kinematic equivalence can’t therefore be assumed for all systems. Yet, the assumption is fundamental because the particles of any material, during their evolution, will at least describe a trajectory in space and what we learn about the link between kinematic and dynamical quantities applies to all materials, even the ones where the kinematic assumption does not hold.
The first natural question to ask is: why does state evolution of a particle of a classical material always describe a trajectory in space? It’s because spatial extent is the one way in which all materials can be decomposed. As we divide materials into smaller pieces, physical location is one state variable we can assign to the particles of all materials. If we assume kinematic equivalence, the kinematic variables will be enough to identify a particle state. In such a case, we will call the material minimal to highlight the idea that the state is described by the smallest possible number of d.o.f.
When the system is not minimal, the state of the particles will be described by some additional independent state variables. The overall dynamics will be the spatial d.o.f. coupled with the internal d.o.f. Therefore by studying a minimal material, we are also studying a component of the dynamics that is present in all materials. In other words: any material is an extension of a minimal material.
It should also be noted that, once we reduce particles to be infinitesimal at a point, the rest of the description must be a local object invariant under coordinate transformations. This means that the remaining internal state must be identified by scalar, vector or tensor quantities. This may be used in the future to justify the extension of this work to field theories. ∎
VII.B Space-time manifold and Lagrangian mechanics
As we need to describe trajectories, we introduce as the dimensional manifold that defines physical space and time. A point in will be identified by , its time and space coordinates. A trajectory will be given by a set of functions where is an arbitrary parametrization of the curve. What we need to understand is the link between the complete state space of the particles of a classical material and the space of all the possible trajectories under the kinematic assumption.
We first note that the system of units for the trajectories is fully defined by . Any trajectory can be specified once a set of coordinates is chosen. Under the kinematic assumption, these units must also be sufficient to describe the dynamics. Therefore has conceptually two roles: it is the space where the motion unfolds and it is the space on which we define the system of units for our states. This already tells us that the state space for the particles of the material is a hypersurface of .
Under kinematic equivalence, given a trajectory we must identify a state and vice-versa. There must be a homeomorphism between the complete state space and the space of possible trajectories. We already know what the complete state space is. We just need to find a way to label the trajectories so that we can express the correspondence.
Because of the double role of , we can set half of our state variables to be equal to the space-time variables: . This already tells us that the trajectory is differentiable since is differentiable. The four-velocity is therefore well defined and it can be used to identify trajectories. The magnitude of the four-velocity can be rescaled by changing the evolution parameter, , and is therefore not physical. Only the direction is physical so the four-velocity gives us another independent variables to identify trajectories. The combined position and velocity, the kinematic variables, identify trajectories using a hypersurface of the tangent bundle . This is exactly the dimensionality of the complete state space . We cannot add more curves, as a homeomorphism preserves dimensionality, therefore we identified the suitable space for the trajectories of particles of a classical material under kinematic equivalence.
Being able to identify particles through either state or kinematic variables is not enough: we also need to be able to express a composite state as the distribution of particle states over position and velocity. As such, the differentiable distribution over state variables must become a differentiable distribution over kinematic variables. This tells us the transformation is differentiable.
Mathematically, the state space is diffeomorphic to a hypersurface of the tangent bundle of the space-time manifold.
Proposition VII.1**.**
Let be the dimensional space-time manifold over which trajectories are defined. The complete state space for the particles of a minimal classical material is diffeomorphic to a hypersurface of the tangent bundle .
Justification. We claim the complete state space is a hypersurface of the cotangent bundle of the space-time manifold, . Let be the evolution of a particle for a minimal classical material. Let be the function that returns the space-time trajectory associated with the evolution. is injective as the material is minimal. can be identified by a trajectory which can be fully described by coordinates defined on . Let be the particle state for a minimal classical material. Let the function that returns the state at a particular time along an evolution . Such function is a bijection as the evolution is deterministic and reversible. can be identified by an evolution and an instant , both fully described by coordinates defined on . defines the unit system. by VI.3.
We claim there exists a homeomorphism between and a hypersurface of . Let be the particle state for a minimal classical material. Let be the evolution associated with that state. Let be the instant of time at which is defined. are state variables as they are real function of the state. is differentiable therefore exists. Suppose is not part of the state. Then must be determined by the law of evolution. is determined by the law of evolution therefore are the only state variables needed from the trajectory. As the material is minimal, determines the full state . This is a contradiction: is not identified by just . Therefore is part of the state. . The map is continuous by IV.4 and is bijective as the material is minimal. It is a homemorphism between and . is a hypersurface of therefore its image is a hypersurface of .
We claim is a diffeomorphism. Let be the evolution of a minimal classical material. Let be the distribution associated with . as the material is minimal. is differentiable by the same logic expressed in V.4. is a diffeomorphism as it is a homeomorphism that maps a differentiable function to a differentiable function. ∎
This relationship allows us to write the kinematic variables in terms of the state variables. In particular we have . As the relationship is invertible, these functions must be monotonic in . Since , is convex in . Under such conditions we can define a Legendre transformation . Such transformation is the Lagrangian of the system and the motion is given by the Euler-Lagrange equation. For the time independent case, we define where .
Proposition VII.2**.**
Let be an invariant Hamiltonian defined on . Under the kinematic assumption, we can define the Legendre transform which we call the extended Lagrangian.
Justification. We claim is convex in . By VII.1 we can write the velocity as a differentiable function of the state variables. At fixed , must be invertible. The components are monotonic in . . The derivatives of in are monotonic in . is convex in .
We claim there exists an extended Lagrangian . is convex in . It admits a Legendre transform. The extended Lagrangian is such transform. ∎
Not only must we be able to express distributions in terms of both state and kinematic variables, but integration has to carry over as well. To do that, we need to be able to count trajectories in the same way we are able to count states. Just as the symplectic form gives us the count of possibilities for a d.o.f. in terms of and , the ranges of the state variables, there should be a bilinear form that gives the the count of possibilities in terms of and , the ranges of the kinematic variables. Under the kinematic assumption, these counts must be consistent with each other. That is: .
Since both and are four vector components, is a rank two tensor on . To each direction in space-time is associated a direction in the tangent space of velocities with which it forms a d.o.f. Across d.o.f., that is , we have . Therefore if and do not form a d.o.f., : is reflexive. We also know that cannot be alternating, that is : a choice of units for is a choice of units for and therefore they cannot belong to different d.o.f. This means is a symmetric non-degenerate tensor. We recognize it as the metric tensor and therefore is a pseudo-Riemannian manifold.
Since is symmetric, it can be diagonalized: . As we must have . As we must have . We can further change the units along the spatial directions so that : if we use the same units for the spatial coordinates, each direction will contribute the same number of possibilities. Since time must use a different unit, we set where is the constant that allows one to convert the possibility count over the temporal d.o.f. into the possibility count of a spatial d.o.f. Therefore, locally is Minkowskian.
Proposition VII.3**.**
The space-time manifold is a pseudo-Riemannian manifold . has signature and locally is .
Justification. We claim is a pseudo-Riemannian manifold where is a metric tensor induced by under kinematic equivalence. Let be an infinitesimal range of possibilities for the kinematic variables of the particles of a minimal classical material. There exists a map such that . The map is linear, since a linear combination of infinitesimal ranges leads to the linear combination of possibilities. is a rank two tensor. Suppose . . is reflexive. Position and velocity along the same direction use related units. They cannot form independent d.o.f. . is not alternating. is symmetric. is a symmetric rank two tensor. is a pseudo-Riemannian manifold.
We claim is locally Minkowskian. Let be a choice of coordinate that diagonalizes . exists as is symmetric. . . We require when the arguments are positive. Therefore and . has signature . Choosing the same unit for all and a temporal unit for we can choose coordinates such that locally . is locally Minkowskian. ∎
The metric tensor and the constant found here are indeed the ones used in the context of special relativity. Yet, they have acquired a different meaning. does not measure space-time distances: it counts possibilities of a d.o.f., like . Directions in space are orthogonal not because the angle between them is , but because they identify independent d.o.f. That is, the choice of units along one direction is independent from the choice of units along orthogonal directions. Space and time, instead, are not independent d.o.f. and the geometry between them is different. In other words: inherits its signature from . The geometry of space-time is the geometry of the ranges for possible states.
This also allows us to give a more insightful physical meaning. It is not a velocity: the metric is defined at each point without motion. It is the constant of proportionality that maps a range of initial conditions from the time variable to the space variable . For example, once the SI is adopted, km would correspond to a thousand times more possible states than m, and, in the same way, sec would correspond to more possible states than m. Therefore when we write or we are really expressing everything in quantities that are proportional to the count of states and possibilities. These coordinates make the bookkeeping of number of states much easier which, as we saw, is the only thing that Hamiltonian and Lagrangian mechanics are doing.
This also allows us to understand heuristically why the speed of deterministic and reversible motion cannot be greater than . Consider the trajectory of a point particle. Over an interval it will travel in space. Since the motion is deterministic and reversible, and therefore continuous, it will travel through all the states defined in the interval . It will also travel through every moment in time, which corresponds to possibilities. As it moves, time will always change but not necessarily space. The number of states traveled in space cannot exceed the number of states traveled in time. Therefore we have:
[TABLE]
Note, though, that this constraint applies only to deterministic and reversible motion. It was under that premise that we were able to show that the trajectories are continuous, that we could define and therefore . Non-local quantum effects, such as the ones featured in EPR EPR experiments, are not examples of deterministic and reversible evolution. Therefore they do not have anything to violate: the maximum speed does not apply to their “motion.”272727The very notion of velocity becomes ill defined in such cases precisely because we do not have a unique well-defined evolution. On the other hand, only deterministic and reversible motion can carry information and can establish before/after relationships, therefore everything remains consistent.
VII.C Massive particles under scalar and vector potential forces
The link between and allows us to constrain the possible diffeomorphisms between state variables and kinematic variables. If we express the possibilities in terms of both state variables and kinematic variables we have: . Since , we have , where is the constant of proportionality. We recognize as the inertial mass. Integrating the expression, we have where is an arbitrary vector field.282828Note that corresponds to the product the vector potential and the charge. This simplifies the notation and avoids having to find a symbol for the charge itself. This is the most general link between velocity and conjugate momentum, which is the sum of kinetic momentum and a scalar potential.
This constrains the form of the extended Hamiltonian. . Integrating we have where is an arbitrary function. We can further constrain the Hamiltonian by choosing the natural parameterization for (also called unit speed Lee or arc length parametrization) for which the modulus of the velocity is constant. We have . . Applying the same procedure in the time independent case yields the Hamiltonian .
We recognize the Hamiltonian for massive particles under scalar and vector potential forces.
Proposition VII.4**.**
The extended Hamiltonian for the particles of a classical material under the kinematic assumption is .
Justification. We claim the conjugate momentum expressed as a function of the kinematic variables is where is a differentiable vector field. . Let be the proportionality constant. . . After integration where is an arbitrary vector field.
We claim the Hamiltonian is . . After integration where is an arbitrary function. Let be the natural parametrization such that . as by VI.7. . ∎
The above discussion gives the inertial mass a new physical meaning: it is the conversion constant that tells us how to convert a range of velocity to a range of conjugate momentum with the same number of possibilities. In other words: the more massive the particles, the more states per unit velocity. Intuitively, a more massive body is harder to accelerate because it has to go through more states for the same change in velocity. Also note that the Hamiltonian excludes massless particles because the kinematic assumption does that implicitly. A massless particle always has the same velocity, , therefore the trajectory is not enough to tell us the dynamics. The motion of the photon is not enough to tell us its energy or its momentum. Therefore it makes sense that, by assuming kinematic equivalence we derived an equation valid only for massive particles.
We have seen that the inertial mass , the invariant speed and the reduced Planck constant all serve similar purposes: convert one quantity to another preserving the number of possibilities. converts between ranges of wave number and conjugate momentum. converts between ranges of time and space. converts between ranges of velocity and conjugate momentum. They allow us to keep proper bookkeeping when mapping sets of states. Using natural units means measuring all these quantities through the possibility count. There is a difference among them, though: while and are simply determined by the unit system, also depends on the type of material. That is, different homogeneous materials can have different inertial mass. The reason is that the choice of units for already determines the others ( and ) therefore the link between units of and is not a new unit conversion. In other words: is not just another arbitrary constant set by the choice of units.
Another important thing to note is that the relationship between conjugate momentum and velocity, , includes an arbitrary function. As it is arbitrary, we cannot give a well defined physical meaning in terms of the space-time trajectory. Suppose, in fact, we changed and while leaving unchanged, the physical description in terms of trajectories remains the same.
We should also ask whether any choice of actually represents a different case leading to different trajectories. The simplest and more insightful way to study this problem is to use the kinematic quantities and as state variables. They are not going to be conjugates of each other but they do capture the entire physical description. Any change in that does not affect the relationship between and does not change the physics. Expressing the Hamiltonian and the Poisson brackets in terms of the kinematic variables we have:
[TABLE]
Note how the constraint simply sets the rest kinetic energy. Note how the Poisson bracket between kinetic momentum is the force tensor. The weaker the force, the more become independent d.o.f. The force tensor, then, tells how much fail to be independent d.o.f. With these expressions, the Poisson bracket between any function of position and kinetic momentum can now be calculated. For example:
[TABLE]
where we recognize the covariant form of the Lorentz force.
Any change of that leaves unchanged does not affect the evolution of any function of position and velocity. Such transformation is what we call a gauge transformation. Note the same group of transformations is found by fixing and changing such that the laws of motion don’t change. In other words: and are defined relatively to each other. defines the [math] for and vice-versa. The gauge group expresses the arbitrariness of such a definition.
The extended Hamiltonian we found is quadratic in energy, therefore negative energy states are possible. These correspond to the particle anti-states mentioned in VI.6. As we fixed the natural parametrization, , there are two cases: the parametrization is aligned with time, therefore where is proper time, or the parametrization is anti-aligned with time, therefore . The trajectory velocity is plus or minus the physical velocity depending on whether it’s a standard particle state or an anti-state. Expanding the equation for the force, we have:
[TABLE]
Therefore the force acts on anti-particle states in the opposite way: they act as if they have opposite charge. Note that nothing physical is actually going backwards in time, just the parametrization.
In this setting, charge conjugation is simply changing the parametrization from to . This will permute particle standard and anti-states as they follow the trajectories in the opposite direction. But if we apply parity and time reversal , changing to , we would have the same net effect: the parametrization stays the same, but it now moves backwards in space and time. As they have the same net effect, if we apply all three we go back where we started. This gives us a very intuitive classical particle mechanics analogue for the theorem Weinberg ; ClCPT .
Again we want to stress just how the math takes a very simple and physically meaningful form when studying the motion in phase space using position and kinematic momentum. It is most expressive because, by using the kinematic variables of a deterministic and reversible motion of an infinitesimal amount of material, it makes use of all the assumptions about the system we are studying.
To sum up, the kinematic assumption has more inherent consequences than one would expect at first. It means the particles are identified by position and velocity and therefore the system of equations is second order. It links the space of initial conditions on with the space of states on . Such a link allows phase space symplectic form to induce the space-time metric tensor . It allows us to define Lagrangians. It constrains the motion to massive particles under scalar and vector potential forces. Moreover, it allowed us to reunderstand basic concepts, like the invariant speed , the inertial mass and the force tensor in terms of state counting and d.o.f. independence. Finally, it allowed us to construct classical equivalents for anti-particles and the theorem.
We now have all the building blocks of classical mechanics, the consequences of three seemingly simple assumptions. We have more insight into why these blocks fit together the way they do. But we have also placed ourselves in a very good position to move forward to quantum systems by using the new physical insights we have gained.
VIII Prelude to quantum
In section V we made the key assumption of infinitesimal reducibility which led to classical Hamiltonian mechanics. We are now going back to that point, that is we set aside the kinematic assumption and time dependent evolution, and take a different path. But before introducing assumption IV and deriving quantum mechanics as its consequence, we first give a semi-classical account of the conceptual picture that emerges. This allows us to build the intuition more gradually and to show that classical and quantum mechanics are not as different as one may first imagine.
We will see that, as a first approximation, quantum particles are more suitably described by classical composite states (i.e. distributions in phase space) like any other object made of a finite amount of material. We’ll also see that classical distributions already possess qualitative properties that are typically associated with quantum systems, including a classical analogue of the uncertainty principle.
VIII.A The case against point particles
As we defined them in previous sections, classical particles are the infinitesimal limit of subsequent subdivisions and therefore should not be understood as point-like objects of finite mass. It was their being infinitesimal and spread around a small neighborhood that gave us conjugate pairs of state variables and Hamiltonian evolution. Any finite amount of classical material, therefore, is described by a distribution. If we take a quantum particle, say an electron, it has a finite amount of charge/mass/energy. Therefore, to a first approximation, it must be described by a distribution as well.
The idea that an electron is not a point particle may, to some, seem preposterous at first. But we contend that it is no more preposterous than to think it point-like, described by a probability distribution that self-interacts. In fact, the idea of an electron being a distribution of material is already conceptually more compatible with two features of quantum mechanics.
The first one is that quantum particles are not associated with a well defined value for position and momentum. If we misidentify the electron with a classical particle (i.e. the infinitesimal part of a classical material), this would indeed be worthy of note and puzzlement. But if the electron is a distribution, there is no issue because a phase space distribution does not have a single value for position or momentum. The earth is, so to speak, in both North America and Europe at the same time. In fact, based on what we saw before, any object of finite mass is a distribution over a region of phase space, and discontinuous distributions are ruled out by IV.4. An electron is an object of finite mass: why should it be any different? In fact, if one claimed an electron to be point-like, he would be claiming an electron is fundamentally different than all other physical objects of finite mass/energy (which are the only ones we experimentally work with). Shouldn’t he have the burden of proof?
The other feature is particle-wave duality. If the spread of the distribution is narrow enough for the problem at hand, the motion can be described by just the position and momentum of the center of mass, making it behave like a classical particle. If the spread is not negligible (e.g. the object encounters obstacles or slits of a smaller scale) then we have to use the full distribution. Therefore, even in this classical approximation, the electron would have this dual nature depending on the problem.
While this picture is quite reasonable, some people may reject it because they believe that a fundamental object must have no size, it must be a point. But that does not follow: lack of spatial extent and lack of substructure are independent concepts.
In fact, we can conceptually construct an infinitesimal object that is not elementary. Suppose we have dots moving on the surface of a sphere. Their motion can be expressed in terms of their polar and azimuthal angles. If we shrink the sphere, the dynamics and its description stays the same. We can collapse the whole sphere to a point: it is now a point-like object that is not elementary, as there is motion detectable along different angles of incidence.
Whether a physical system has a distinguishable substructure depends on whether there exists a physical process that can interact with one of its parts independently of the others. If we are always forced to interact with the whole system, then we can’t find any discernible part. The fact that the system is extended in space is a separate property, which does not necessarily imply the existence of such a process.
If we abandon the idea of point-like objects of finite mass, we avoid these problems and get a picture more consistent across the different realms of physics. And we can also see that classical mechanics already has some features that are commonly ascribed to quantum mechanics.
VIII.B Classical uncertainty principle
Suppose we have our classical electron described by a finite amount of classical material distributed over a single d.o.f. where is the normalized distribution. In this context, we will call a fragment an infinitesimal part of our classical electron. The Shannon entropy Shannon associated with the distribution is finite as well. . Intuitively, this value can be thought of as the amount of information required to identify a fragment within the distribution.292929To be precise, Shannon’s differential entropy is actually the number of bits required to identify an element of the given distribution relative to one of a uniform distribution of unitary range on all axes.
As the state evolves into its final state, the amount of material remains the same: . The final entropy will also remain the same: . Mathematically, because , like the distribution itself, is just another integrable function, its integral is conserved by Hamiltonian evolution. Physically, the entropy remains unchanged because the amount of information required to identify a fragment given the distribution has to remain the same under deterministic and reversible evolution. Therefore, in the same way that each fragment is constrained to move through states at equal energy, the composite state is constrained to move through distributions at equal entropy.
We now ask the following question: once we fix the entropy, what is the relationship between the spread of the marginal distributions along and ? Using Lagrange multipliers, we fix the total amount of material to and the total entropy and find the distribution that minimizes the product of the variance .
[TABLE]
We solve the multipliers and have:
[TABLE]
We find that the distribution that minimizes the spread is the product of two independent Gaussians. Recall that in quantum mechanics, the Gaussian wave packet is the state that minimizes uncertainty: this is the classical analogue.
As the distribution evolves, the entropy is conserved and therefore the product can never be less than the one given by the Gaussian distribution of the same entropy. We have:
[TABLE]
This is strikingly similar to the Heisenberg uncertainty principle, except that the value depends on the initial entropy .
Suppose, though, that while the evolution of the distribution of our electron as a whole is deterministc and reversible, each fragment is undergoing non-deterministic motion. Suppose is a distribution at equilibrium of such motion. While each fragment moves randomly, the overall distribution stays the same: the non-deterministic motion is effectively just reshuffling the fragments within the same distribution. The value of the entropy of the distribution, and therefore its spread, is set by the non-deterministic motion of the fragments: the stronger it is, the greater the entropy.
Suppose now our classical electron undergoes quasi-static evolution. At each instant we can assume to be at equilibrium. At each instant the fragments are reshuffled. At each instant the entropy of the distribution is the same one associated with the random motion. The overall evolution is still Hamiltonian, but the trajectories predicted by the framework are now just the average motion of the fragments.
If we assumed that any classical electron were affected by the same source of randomness, all fragments would exhibit a random walk of the same magnitude as defined by the information entropy. The spread of all distributions for the material would satisfy the same inequality. This gives us the classical uncertainty principle: where is the entropy associated with the source.
Such an assumption is not far fetched. The source of entropy could be identified in the environment (i.e. a minimum interaction that cannot be avoided as perfect isolation cannot be achieved) or the internal self interaction of the fragments (i.e. the evolution of the unstated part). Whatever it may be, if it is characterized by an entropy comparable to the one of the distribution (i.e. if we are trying to localize the electron better than the source can allow) the classical assumption breaks down as the random motion of each fragment is not negligible.
The generalization to multiple d.o.f. is outside of the scope of this work. Note, though, that this result is related to the Gromov non-squeezing theorem and the symplectic camel, which are already generalized to multiple d.o.f. It is the link with information theory that gives us further physical insight and is of particular interest given the strong connection between thermodynamics and Shannon’s entropy.
This discussion shows, once again, how we can already find in classical mechanics some of the ingredients that are typically assumed to be characteristics of quantum mechanics. It has its own flavor of anti-particles, theorem and uncertainty principle. These should really be considered general features of deterministic and reversible evolution of distributions (i.e. Hamiltonian mechanics). Quantum mechanics just inherits these traits.
The discussion also gives us an intuitive physical picture that we will develop further in the next section: a quantum particle is a well determined distribution of not well determined fragments. The distribution as a whole can be studied and evolves deterministically while the fragments do not.
IX Irreducible systems
In this section we explore a different relationship between the whole and its parts. We will consider an irreducible material, one where the state and the evolution of the whole does not tell us anything about the state and the evolution of the parts. The material is still conceptually infinitesimally decomposable, made of infinitesimal parts which we call fragments. But each fragment cannot be studied independently and therefore cannot be assigned a state: the internal dynamics is undetermined. We’ll find that the evolution of an irreducible material is suitably described by the standard framework of quantum mechanics.
IX.A Quantized material
In section V we introduced the idea of a classical material, one that is homogeneous and infinitesimally reducible, which represented a way to relate the state of the whole system to the state of its parts. In this section we explore an alternative case.
We will call a quantized material a homogeneous material that is finitely reducible. That is, as we decompose the system we can only assign a state to finite amounts of material, which we call quantum particles. As the material is homogeneous, all its particles carry the same amount of material and are described by the same state space. Each quantum particle is irreducible: its state does not tell us anything about the state of its parts. While this idea should be familiar enough, it is best to iron out some details to avoid possible misconceptions.
The first possible source of confusion is between divisibility, the idea that an object can be divided into parts, and reducibility, the idea that the state of the whole is equivalent to the state of the parts. More precisely, a system is divisible if there is a time evolution that takes the state of a system and returns the state of two separate isolated systems. It is reducible if , the state of the system is the state of the two subsystems. Most of the time these two concepts overlap, but they are separate as we can see in the following examples.
Consider a planarian flatworm. If we cut it into multiple pieces, each part will grow into a new worm. Yet, the state of each worm is not the state of multiple worms put together. The planarian is divisible into multiple worms but it is not reducible to multiple worms. Consider a magnet. Its state is described, to a first approximation, by the position of the north and south poles. Yet, we cannot divide the magnet into a north and south pole. The magnet is reducible to the poles but is not divisible into the poles.
Consider a muon. It will decay into an electron and two neutrinos. But the state of a muon is not the state of an electron and two neutrinos. The muon is divisible into the three particles but it is not reducible to them. Consider a proton. Its state is given by the state of its three valence quarks and the gluon field. Yet, we cannot divide the proton into the three isolated quarks. The proton is reducible to quarks, but not divisible into quarks.
The fundamental property of a quantum particle, as introduced here, is not indivisibility: it’s irreducibility. It is the state that cannot be further partitioned, not the material itself.
Even more subtle is the difference between divisibility and decomposability, the idea that the object has parts. That is, a system is decomposable if there is a law to combine two states to get a third. While irreducibility says nothing about whether a quantum particle can be divided, it implicitly assumes that it can be decomposed. Irreducibility describes the relationship between the state of the whole and the state of the parts, therefore the existence of parts is implicit in the definition. But it also tells us that we are limited in what description we can give to these parts: we cannot isolate them as we want and act on them independently because if we were able to do that we could assign them an independent state.
Therefore, while we must be able to talk about parts of a quantum particle, not all questions will make sense. Can we ask what fraction of a quantum particle is in a particular region of space? Yes, since the particle can be spatially decomposed some amount of material may be inside the volume. Can we ask where the fragments in that same fraction will be at a later time? No, since the particle is irreducible we cannot describe the evolution of a part.
Note that if the material is infinitesimally reducible (i.e. the classical case), reducibility/decomposability/divisibility are all possible. This is why one may not dwell on their difference and use the word “part” interchangeably in the three cases. In the quantum context, instead, we assume irreducibility, so it is better to use more precise language to avoid confusion. Therefore we will call fragments the infinitesimal parts of the material that cannot be described independently. We will call components the parts that the material can be decomposed into. A component will have a state associated with it, and therefore will always be a collection of fragments.
The proper way to think of a quantized material is therefore the following: a continuum of infinitesimal fragments clumped together to form quantum particles, the smallest amount of material to which we can assign a state. With this picture in mind, we can see, even before developing the math, how some features typical of quantum behaviors emerge.
The first feature is the importance of statistics. Consider a fragment of a quantum particle in an initial state. As we cannot track its motion, it can correspond to any fragment of the particle in its final state. That is, the motion of a fragment of a particle is a random walk within the evolution of a particle.
The second feature is non-locality. Suppose we have a quantum particle distributed in space. Suppose we exert a force only on a subregion of its distribution. As the particle is irreducible, we cannot interact with only part of it: we must also affect the part where no force is exerted. We cannot simply interact with the part at a specific region, as this would allow us to assign a state to that part.
Wave-particle duality is also accounted for. The quantum particle behaves like a wave in the sense that its parts form a distribution in space. Yet, it behaves as a single unit, as the state is irreducible and cannot be split.
The most striking feature, though, is that we can predict the functional form for particle decay over time. Suppose a quantum particle spontaneously decays into two or more particles. Such a process cannot be deterministic as the number of d.o.f. increases. As the decay is spontaneous, it is not triggered by the environment (i.e. external state). It must be triggered by the internal dynamics of the fragments. As we assumed the internal dynamics is unknown, we cannot learn anything about it by looking at the product of the decay. In particular, all states have to have equal chance of decay or we could tell that the internal dynamics is more stable for some states. The probability of decay is constant for all states at all times. The probability of survival follows the exponential distribution.
As we see qualitatively how the features typical of quantum mechanics naturally emerge from this picture, we are ready to make this more quantitatively and mathematically precise.
IX.B Irreducible material and complex vector spaces
It is time to turn these concepts into a precise mathematical formulation as we did for classical mechanics. We want to formalize the state space for an irreducible material as a quantum particle will be a unit amount of such material.
As for the classical material, the irreducible material is thought to be decomposable: each amount can be seen as the sum of different components (e.g. spatially distributed). Therefore V.1 applies and the state space of an irreducible material is an abelian group.
Yet, the description of each component cannot be more accurate than the description of the whole. To capture this idea precisely we need to characterize the aspects of the unstated part that influence the state definition. How do we do that? We can look at the classical derivation for guidance. In that case, we looked at the set of transformations that increased/decreased the amount of material. The idea is that we can think of these transformations as characterizing what the state can and cannot say about the infinitesimal parts.
Suppose we have a state for an amount of classical material. Suppose we assigned a numeric identifier to each particle of the material. This identifier would be just a dummy label we assign, not a physical quantity. As the classical material is homogeneous, permutations between classical particles within the same state have no effect. Therefore the ordering given by the identifier does not matter. Identifying a classical particle within a composite state is equivalent to picking a number from a random variable uniformly distributed over an interval of size .
Suppose we have another state where the only difference is an increase/decrease of the amount of material by a factor . The random variable that identifies a particle of is now a uniform distribution where the range is the new amount of material: there are now proportionally more/less labels to assign. This is also the only possible transformation that can link the two uniform random variables and . Therefore increase/decrease of material is the only operation that is captured by the state among those that affect the labeling of the fragments. In other words: the classical state does not care about the permutation of the fragments, but it cares how many fragments are there.
For the irreducible material we follow the same strategy and study the transformations that affect the labeling of what the irreducible state cannot tell us: the configuration of each fragment. Similarly, the irreducible state will not care about permutations of fragment configurations, but it will care how many fragment configurations are there.
Suppose we have a state for an amount of irreducible material characterized by one d.o.f. The configurations of the infinitesimal fragments will be identified by two values, as a d.o.f. is two-dimensional. Each fragment configuration is identified by a pair of independent random variables , which are, as before, just dummy variables we use to name the fragment configurations. As the material is homogeneous, the distribution is uniform or we could tell something about the fragment configurations. We choose A and B to be uniform distributions of interval : identifying a fragment configuration is like picking a point at random over a square of area , the amount of material.
Suppose we have another state , where the labeling for the fragment configurations has changed. We can label the fragment configurations of in the same way, with two independent uniform distributions . But since the labeling is the only thing that has changed, we must be able to relate the new distribution over to the old distribution over . The relationship between the two pairs of variables must be linear since all distributions are uniform. . To preserve the square distribution we must then have . We can write as and are the only parameters of the transformation. Or more compactly, where .
The transformation increases/decreases the area by the modulus , which physically corresponds to the increase/decrease of amount of material. It also rotates the square by the phase , which corresponds to a change in correlation: if , are clearly correlated while if , are clearly anti-correlated.
This line of reasoning is fairly abstract and it may seem to have no bearing with quantum states. Therefore, jumping a bit ahead, let’s see if we can already find quantitative consequences of this model and see whether they are consistent with our knowledge of quantum mechanics.
If the amount of material is connected to the area of two uniform distributions, it should combine like the variance of a random variable. And in fact it does. Suppose and are two random variables,
[TABLE]
where is the variance, the standard deviation, is the Pearson correlation coefficient Grimmet . As , the total variance can be greater or smaller than the sum of the variance of the components. Now suppose is the state for a unit amount of irreducible material (i.e. a quantum particle). We can write . We have:
[TABLE]
The two expressions are formally identical and it shouldn’t come as a surprise. The more material we have, the more labels for the fragment configurations to choose from, the bigger the spread of the random variables that assign the labels. takes the place of the Pearson correlation coefficient. Quantum interference can then be understood in terms of the combination of correlated/anti-correlated distributions.
If the phase determines the correlation between two states, then it should only be meaningful when comparing two states. And in fact only differences in phases are physically distinguishable in quantum mechanics. A more meaningful name for the phase, then, would be correlation angle.
If quantum states are uniform distributions over fragment configurations, we should see a hint of that when computing distributions over observables. And in fact we do. Suppose we have , an eigenstate of some observable. Then it is also an eigenstate of the infinitesimal transformation of the conjugate variable . Since it has a symmetry over , the distribution has to be equal at each value of : the distribution is uniform.
If quantum particle states are really just unit amounts of material uniformly distributed, we should be able to calculate the Shannon entropy associated with them. Using our dummy variables, . For a quantum mixed state , we have . And in fact this is the Von Neumann entropy Von Neumann used in quantum information, that implicitly assumes all states provide the same amount of entropy (i.e. zero).
If two quantum particle states and are really just two states at equilibrium with the same entropy, we should always be able to find a deterministic and reversible evolution to connect the two. And in fact we can. Take the plane identified by and . Find the infinitesimal rotation along that plane. is the unitary evolution of the other. Note that this is not always possible in classical mechanics, as two states and may have different entropy.
In other words, our simple model is not only consistent with quantum mechanics but it has predictive power: it provides intuition that is well supported by these findings. It is not “just a mathematical trick.”
If we increase the number of independent d.o.f. the group of transformations remains the same. While we have more fragment configurations to label, each d.o.f. is labeled independently. Therefore we have uniform distributions, each over a square of the same amount of material. This means that, as we combine components, the labels have to combine in the same way along the different d.o.f.: the increase/decrease of material and the change in correlation has to be the same across all d.o.f.
Mathematically, the state space for an irreducible material is a complex vector space. It is so because it is the state space for a decomposable material (i.e. an abelian group) where we can increase/decrease the amount and change the correlation of the internal description (i.e. a set of transformations conveniently parametrized by a complex number).
Proposition IX.3**.**
The state space for an irreducible material is a vector space over .
Justification. We claim is an abelian group. is the state space for a decomposable homogeneous material and is therefore an abelian group by V.1.
We claim the set of physically distinguishable transformations that relabel the fragment configurations is isomorphic to . Consider an amount of irreducible material characterized by one d.o.f. The configuration of a fragment of the material is characterized by two random variables where is the sample space for the configuration of the fragments. As the material is homogeneous, and can be chosen such that the distribution of material over such variables is uniform over a range of for both variables. We have . Consider a second amount of irreducible material where we changed the labeling of the fragment configurations. Its fragment configurations can also be characterized by a uniform distribution over two variables over a range of . As the two amounts of material differ just by the labeling of fragment configuration, is a function of . We have where is the Jacobian determinant. As both distributions are uniform, has to be constant. The transformation has to be linear: and . As the change in amount of material, the only physically distinguishable quantity associated with the fragment configurations, is fully specified by and , no other transformation is physically relevant for the state. Let represent such a transformation parametrized by . is the ratio of the two amounts of materials and is physically distinguishable. Define on an addition and a multiplication such that and , , the sum and product of the transformation is equal to the sum and product of their respective factors. The phase under addition is physically distinguishable as it can affect the modulus of the result. is an isomorphism between and as fields. Assume now that the material is characterized by multiple independent d.o.f. The transformation on each d.o.f. is defined independently by . As is the same under all d.o.f. . The relationship has to always hold under addition as well, therefore . also for multiple d.o.f.
We claim is a vector space over . The abelian group can be extended with the operations defined by as was done in V.2 for the infinitesimally reducible case. ∎
IX.C Complex valued distributions
In the previous sections we saw how a finite amount of classical material was described by a distribution over the state variables of infinitesimal parts. For an irreducible material, we cannot assign states to the fragments, therefore we cannot properly talk about state variables. Therefore we call fragment variables the quantities that we use to label the fragment configurations, and it will be over these variables that we will define the distribution of irreducible material.
Naturally, we cannot give a complete description for the configuration of a fragment, therefore we cannot give a joint distribution for all fragment variables at the same time.303030This recovers the notion of complementarity introduced by Bohr Bohr . We can, though, find a maximal set of fragment variables: one that can be used to provide the best description possible. While there isn’t a unique maximal set, we can show that one such set is provided by the fragment variables that define the units required to describe the system.
In fact, we cannot add a new d.o.f. (as this would mean changing ) and we cannot add a new fragment variable in an existing d.o.f. (as this would fully specify said d.o.f.). Therefore the set of fragment variables already provides a maximal set of fragment variables. This means that a state must tell us for each point in the amount and correlation angle of the material. That is: the state will be identified by , the wave function over .
The square modulus at each point will give us the density of the material. As in the classical case, such density must be integrable to give us the total amount. Therefore the function is square integrable. The norm will give us the amount of material associated with the state.
As the material is homogeneous, all its quantum particles are made of the same amount. We can set, by convention, the amount of material for a particle to be unitary, therefore quantum particle states are the subset of such that . As we have seen, changing the phase by a constant only affects the unstated part. Therefore normalized distributions that differ by a total phase are not physically distinguishable and represent the same quantum particle state.
Proposition IX.4**.**
The state space for an irreducible material is isomorphic to a subspace of the space of Lebesgue square integrable continuous functions. That is under the isomorphism where is the space of wave functions over . The state space for a quantum particle is isomorphic to the projective space .
Justification. We claim the manifold that defines the units to describe a fragment of an irreducible material also provides a maximal set of fragment variables: no other fragment variable can be added. Let be the manifold that defines the units. Then for each state there exists a distribution that represents the quantity of material at each point. Suppose this distribution could be further refined. Then another independent variable would exist such that for each state we would have a distribution . cannot be part of a new d.o.f. as it would use a unit defined independently from . This is a contradiction as defines all units. cannot lie in the same d.o.f. as of one of the or it would provide a complete description for the fragment. This is a contradiction as the material is irreducible. provides a maximal set of fragment variables.
We claim as a vector space. The maximal physical description of a fragment configuration is given by a point in parametrized by and by a transformation parametrized by . For each there must exist a wave function that provides the maximal physical description for the state. as the square modulus of is the increase/decrease from the unit amount of material. by IV.4. by the same arguments in the justification for V.4. Therefore . by the same arguments in the justification for V.3. Therefore . Let be the function that given a state returns its wave function. As the wave function captures the maximal description of the system, two different states must represent different distributions. . is injective. is a bijection between and . Let , then as combining the distributions means combining the statistical description of the fragment configurations. Let , then as transforms the fragment configuration description by the factor . is a homomorphism between vector spaces. is isomorphic to .
We claim the state space for a quantum particle is isomorphic to the projective space . Let be the state of a quantum particle. with is not physically distinguishable from as phases are only physically distinguishable through addition. with cannot represent a quantum particle as it has a different amount of material. There exists only one distinguishable quantum particle state in the equivalence class with . The state with no amount of material does not correspond to any particle state. The quotient space is isomorphic to the state space for quantum particles. ∎
IX.D Inner product and operators
In both the reducible and irreducible case, the material is distributed over . The do not label the states of a finite amount of material, but the configurations for the infinitesimal parts. For a classical material, the infinitesimal parts can be given a state, have their own topological space and a set of local state variables to identify them. We can use the richness of differential geometry. For an irreducible material, the infinitesimal parts cannot be given a state, cannot be fully identified by a set of variables. We have to use other mathematical tools, typically vector spaces. As we will often use linear combinations of states, we will write, for brevity, instead of . That is: each complex number still represents a state transformation.
For the tool set to be on par with classical mechanics, such that we can write the equations of motion, we need to address three requirements. We need to be able to compare two states and ask what fraction of them share the same configuration: this will give us an inner product. We need to be able to express distributions and expectations for different quantities: this will give us self-adjoint linear operators. We then need to identify the self-adjoint linear operators for the quantities and and to be able to express the distribution of material in terms of those. Let’s start with the first.
The idea is that, given two states and , we should be able to tell how much of is prepared in the same way as . That is is the combination of the component that is prepared like (e.g. same distributions in position and momentum) and the component that is prepared completely differently. Let be the operator that gives us the component prepared like . This operator is linear in : the component of the combined system that is prepared like is the sum of the subcomponents that are prepared like . It also gives us the same result if applied once or twice: once we find the component that is prepared like , it remains the same. is therefore a projection: a linear operator such that .
If is already prepared like , then its projection on will be equal to . Conversely, if the projection of is equal to itself, then it means that the state is already prepared like . That is: . Because of this, we can define a non-degenerate complex product such that .
The projections have other useful properties. Because the material is irreducible, if some fraction of is prepared like , then the same fraction of is prepared like . If not, studying the fragments of one state would give us a better (or worse) description for the fragments of the other state. Therefore we have . This tells us that .
Lastly, if we take the projection of along and we project it again on , we end up with a component of . As this is a part of prepared as , its state is just rescaled, with no change in correlation. That is: with . This tells us that .
Because of the properties of the norm and the projections, the product is positive definite, linear and conjugate symmetric. In other words, the state space for an irreducible material is an inner product space derived by the norm and projections.
Proposition IX.5**.**
The state space for an irreducible material is an inner product with such that .
Justification. We claim there exists a map such that and . Let be the map that returns the amount of material for a given state. Let be a state. . as the only state with no material is the empty state.
We claim there exists a projection with . Let be a state. Let be an operator that returns the component of a given state that is prepared as . is linear as the component of the composition prepared like is the composition of the components so prepared. is a projection because the result of is prepared as .
We claim for some . Let such that . The whole state is prepared as . We can obtain from by relabeling the fragment configurations. for some . Let such that for some . Then all of is prepared as . . Therefore .
We claim . Let . As the material is irreducible, and cannot be used to describe smaller parts. The fraction of that is prepared as must be equal to the fraction of that is prepared as . . Multiplying by we have . This holds for the empty state as well. Let be the empty state. because it has no material and as no component of the empty state is prepared like .
We claim for some . Let . Consider : we first take the component of prepared like and then take the component of that prepared like . The overall operation is simply returning a part of . This must correspond to the same exact configuration for the fragments. The only thing that can change is the amount of material. Therefore for some .
We claim that the state space for an irreducible material has an inner product . and satisfy the requirements in A.4. is an inner product space with such that .
We claim that the inner product can be expressed in terms of the wave functions as . The amount of material associated with a state is . The inner product associated with the norm is with . . ∎
Note that the inner product only has an indirect physical definition, based on the norm and the projections. These latter two concepts therefore provide more physical intuition since the first does not have a straightforward physical meaning.
Also note that the observations made after V.4 for the classical case are still valid. cannot be a complete metric space for the norm induced by the inner product as it does not include discontinuous functions. Therefore it is only a pre-Hilbert space. For mathematical convenience, one can take its completion with respect to the norm induced by the inner product and obtain a Hilbert space. Yet, such an object no longer represents a physically meaningful set of states.
Therefore we need to make sure that the rest of our definitions and justifications do not require a complete metric space to be valid or they would not be physically meaningful. In particular, we don’t want to use the usual link between the wave function and the inner product as the material cannot be prepared at a specific value when is a continuous variable. Similarly, we cannot show that to each state variable is associated a self-adjoint operator simply by expressing it in terms of eigenstates as they may not represent physical states.
We proceed in the following way. Suppose we have a fragment variable . Consider the product : it returns the wave function weighted by the value of . We can also think of as an operator that takes a complex function of and returns another complex function of that represents the distribution of the expectation over the fragments. The operator is linear since . The operator is self-adjoint since . Consider . It integrates the value of weighted by the amount of the material: it is the expectation of the fragment variable over the distribution.
While is enough to define the system of units, it is not enough to define all the fragment variables over which we can express the distributions of irreducible material. The conjugate variables cannot be expressed as a function of , which reiterates the idea that we cannot specify all variables for each fragment. Suppose there is another maximal set of fragment variables. Then those variables will form a topological space such that each can be expressed as a wave function .
As each state can be identified by a wave function on either space, there must be an operator that converts the wave function on one space to the other.313131Note that a neighborhood of is not necessarily a neighborhood of . This relation holds only if and can be expressed as a bijection of each other , i.e. if they are different coordinates of the same manifold. As a linear combination of states corresponds to a linear combination of wave functions, is a linear operator. As converting the space again must give us the original wave function, is unitary. We can now define a linear operator corresponding to fragment variable . Using we can express as an operator over complex functions of . It will still be linear and self-adjoint.
That is: for each fragment variable we have a corresponding linear self-adjoint operator that acts on wave functions over , which can be expressed as function multiplication in a suitable choice of . The (normalized) expectation of is given by .
Proposition IX.6**.**
For each fragment variable there exists a topological space such that and a vector space isomorphism that takes a state and returns a wave function from , the space of wave functions over . There also exists a corresponding self-adjoint linear operator such that is the expectation of multiplied by the amount of material.
Justification. We claim for each fragment variable there exists a topological space such that provides a maximal description and . Let be a fragment variable. Let be a set of fragment variables such that . If does not provide a maximal set of fragment variables then there exist other fragment variables that refine the description. Extend with such variables. If still not maximal, continue extending. As the number of possibilities charted by cannot exceed the number of possibilities charted by , at some point we’ll reach a maximal set. We call the topological space charted by the fragment variables .
We claim there exists a vector space isomorphism . Let be a state. provides a maximal set of fragment variables. There must exist a wave function associated with such that it gives the maximal description for the state as seen in IX.4. Let be the map that associates a state with its wave function over . is a vector space isomorphism for the same reason discussed in IX.4
We claim that for each fragment variable there exists a corresponding self-adjoint linear operator such that is, if it exists, the expectation of multiplied by the amount of material. The expectation value of multiplied by the amount of material is given by where provide a maximal set of fragment variables such that . We have . Let such that . is a linear operator. is also self-adjoint since .
We claim that for any fragment variable there exists a corresponding self-adjoint linear operator such that the integral is, if it exists, the expectation of multiplied by the amount of material. Let be a fragment variable. There exists a corresponding self-adjoint linear operator where provides a maximal set of fragment variables. As both and provide a maximal set, we can define which transforms a wave function over into a wave function over . is an isomorphism as and are isomorphisms. is unitary as . We can extend on all continuous functions and define . is a self-adjoint linear operator. is, if it exists, the expectation of multiplied by the amount of material. ∎
The last thing to do is characterize the conjugate variables and . To be precise, we want to find , the operators that act on the wave functions over corresponding to fragment variables . We know that the operators have to be covariant: under a change of units we must have . In other words: we are looking for the set of linear operators that obey the chain rule. This turns out to be the space of derivations, therefore will be the derivatives in the direction of the corresponding . They have to be self-adjoint, so they will be of the form where is a real number. We choose to be negative by convention and to be unitary so that is expressed in units of inverse as in the classical case. Therefore we have and .
If we assume to be , the functional that converts a wave function in position to a wave function in conjugate momentum is the Fourier transform. As the fragment variables for any power of and must exist, the wave functions in both expressions are infinitely differentiable: the space of the wave functions is the Schwartz space of rapidly decreasing smooth functions.
Proposition IX.7**.**
Let . The operator associated with the conjugate quantity of is . The isomorphism that changes the variable of the wave function from to is . The space of wave functions where is the Schwartz space of rapidly decreasing smooth functions.
Justification. We claim the operator associated with is . Let be the linear operator associated with as expressed on the space of wave functions over . Such an operator must be covariant under the transformation . That is: . In particular, it needs to be covariant when changing only one variable: , where . By A.5 for some . is self-adjoint: for some by A.6. is expressed in units of inverse therefore . By convention, we choose to be negative. .
We claim the operator associated with is . As , their expectation is proportional by a factor of . .
We claim the operator that changes the variable of the wave function from to is . Let be the operator that maps a wave function over into a wave function over , the space charted by . must exist and be unique (up to a total phase) as is an isomorphism. must be a linear transform that takes the operator as expressed over to as expressed over . Such transformation is the Fourier transform. .
We claim . Let . represents the power of the conjugate momentum operator applied to the given state. As the quantity is physically meaningful, such an operation must be defined for any therefore . Let be the wave function over momentum space. represents the power of the operator applied to the given state. As the quantity is physically meaningful, such an operation must be defined for any therefore . As is the Fourier transform of an infinitely smooth function, it decreases faster than any inverse power of . That is: such that . .
We claim . Let and such that . There exists a choice of , such that where as is a Frechet space induced by that family of seminorms. The operator applied to and will provide different distributions for the associated fragment variables. is physically distinguishable and is associated with a physical state. . ∎
We now have all the basic features of the state space of a quantum particle. And we obtained them by re-deriving them from first principles instead of using some formal analogy. The similarities with the classical framework are simply due to the similarities of the starting points.
It should be evident, though, how the correspondence between mathematical and physical objects is not as satisfying as in the classical case. For instance, while any differentiable function of can be a state variable for a classical particle, not all self-adjoint linear operators can be associated with a fragment variable. Consider for which if is an integer and otherwise. Clearly does not preserve the topology and cannot be used as a fragment variable. Yet, we can still create a self-adjoint linear operator, with the same spectra as the one associated with , just with the eigenvalues switched. The space of physically meaningful operators, then, should be further constrained. A reasonable requirement would be that they preserve the differentiable/integrable structure of the Schwartz space as classical state variables preserved the differentiable structure of . Unfortunately, this is not as easy to justify.
The topology of , the space charted by conjugate momentum, depends globally on the topology of . For example, if is an n-dimensional torus, has a discrete topology. That is why, in the end, we restricted ourselves to . Moreover, we characterized the space of functions not because we required them to fall off at infinity, but because we required the ability to express polynomials of and . It is not immediately clear how this generalizes over a manifold: further work is needed.
While the link between math and physics may not be as elegant and as general as one would like, we still managed to meet the goal: we identified the states of an irreducible material and saw how these are related to the states in quantum mechanics.
IX.E Irreducibility
Now that we have fully characterized what we mean by an irreducible material, we can stipulate the following:
Assumption IV** (Irreducibility).**
The system under study is composed of an irreducible homogeneous material and as a whole undergoes deterministic and reversible evolution.
Rationale. The idea is that each amount of material has a state, the physically distinguishable configuration of the distribution, and an unstated part, the physically indistinguishable configuration of the fragments of the material. The system is deterministic and reversible in the sense outlined in assumption I: given the state of the system at one time (i.e. the whole distribution) we can predict/reconstruct the future/past states. But we cannot describe the evolution of the unstated part (i.e. the motion of the fragments).
As we saw, the state space recovered under this assumption is the one used in quantum mechanics. In the following sections we will derive two types of state evolution: the deterministic and reversible one, corresponding to unitary evolution (i.e. Schroedinger’s equation), and a non-deterministic one useful to describe measurement interactions, corresponding to the projection postulate. Therefore, as the infinitesimal reducibility assumption leads to classical mechanics, the irreducibility assumption leads to quantum mechanics.
As we saw in section V.F during the rationale for assumption II, infinitesimal reducibility had its problems. How about the irreducibility assumption? How do they compare?
The methodological problem takes on a different character. In order for the assumption to hold, we need to show that there are no processes at our disposal that can probe the fragments of a quantum particle. For example: an electron as a whole interacts with a photon as a whole. Note that this does not require showing that no such process exists: conceptually, specific parts of the photon may be interacting with specific parts of the electron. But if those processes are not available to us, say because we can only manipulate whole photons and they always interact with a whole electron, they cannot be used to create a more detailed picture. So we simply have to enumerate the processes available to us, which is, at least in principle, feasible. Yet, we can never rule out that someone in the future may discover a new process.
The issues arising from a lack of perfect isolation are addressed. Each degree of freedom comes with its own unstated part (i.e. the motion of the fragments within that d.o.f.); therefore there is no pretense of a perfect description under perfect isolation. Since we cannot describe the nature of the chaotic motion, we cannot say whether it is internally or externally driven.
The problem of physically meaningless interactions is also considerably lessened. Even if we have multiple particles each with their state evolving deterministically, we can still imagine their unstated parts as interacting with each other. Therefore each quantum particle would not essentially reside in its own separate universe.
In these ways, the irreducibility assumption fares much better than the infinitesimal reducibility assumption. Yet, it is still plagued with some of the same problems.
The problem of incompatibility of measurements with deterministic evolution at all levels still remains. The unstated part of multiple irreducible particles may be interacting, but it cannot be used to pass information from one subsystem to another without making itself distinguishable.
The inability to define time using a deterministic and reversible evolution remains a problem. As the system is homogeneous and irreducible, the unstated part cannot give us a measurable quantity that changes in time as that would provide a description of the unstated part.
There is one additional problem, though, not present in the classical case. Under the irreducibility assumption states are necessarily at equilibrium: they all provide the same level of description for the fragments, they carry the same information entropy. In fact if the internal dynamics were out of equilibrium, the material would not be homogeneous which would contradict the assumption. Deterministic and reversible evolution (which we’ll see corresponds to unitary evolution) is necessarily quasi-static: at each moment a state must be well defined, at each moment the system is in equilibrium, the system changes slowly. Therefore quantum states, as formulated here, cannot and should not be expected to provide a valid description during non-deterministic evolution.
In light of this, consider a muon decay: the initial state of the muon and the final states of the electron and neutrinos can certainly be well described by quantum particle states.323232In this context, a state is in equilibrium regardless of its being in a local minimum, easily overcome by fluctuations, or a global minimum, that persists indefinitely. We have no reason to expect, though, that while the muon is decaying into the resulting particles the state is always in equilibrium and therefore well described mathematically by a vector in a complex inner product space. After all, the state of a single spin-one-half particle cannot determine the future state of three spin-one-half particles.
This notion may seem in contradiction to the current practice. For example, the S-matrix, one of the main devices for calculating scattering amplitudes and cross sections, is derived by assuming unitary evolution Weinberg . Doesn’t it imply we are assuming that deterministic and reversible evolution is happening at every instant?
If we look more closely, we realize that the process that the S-matrix captures is a limit where initial states are at and final states are at , a process that takes an infinite amount of time. That is, to calculate predictions for a fast out-of-equilibrium process we approximate it using slow quasi-static evolution. This is actually not so uncommon: it is a standard first approximation in thermodynamics. The question is why should it work here? As we’ll see in more detail when talking about the projection postulate, it’s because of the irreducibility assumption itself.
Suppose we are trying to calculate a quantity that does not depend on the particular motion of the unstated part. Then, by its very nature, its value will be the same under an equivalent quasi-static evolution, because this too does not depend on the particular motion of the fragments. The probability distribution of the out-states during scattering is one such quantity. As the final statistical distribution is determined only by the initial state, it is not dependent on the particulars of the unstated part. In these cases, the use of deterministic and reversible evolution as a “stand-in” to calculate final statistical distributions is justified. However, it should not be taken literally as a physical model of what actually happens. There is no justification for assuming this process to be quasi-static deterministic and reversible evolution of quantum particle states.
In other words, the assumption of irreducibility already contains the seeds of its own demise. On one hand, it tells us that there is a component of chaotic motion within the system. On the other hand, it can only characterize the equilibrium dynamics, which clearly can’t be the full range of dynamics. Yet it also offers a way out: since the motion of the fragments is not accessible, we can predict statistical distributions that are independent of it.
In light of what we discussed, the irreducibility assumption is less flawed than infinitesimal reducibility but it still cannot be taken as fundamental, in the sense that we cannot take it to strictly apply to all systems. We should not expect to solve open problems, such as the arrow of time and the measurement problem, under the assumption as formulated in this work. ∎
IX.F Quantum mechanics
We are now ready to write the equations of motion for an irreducible material. Deterministic and reversible evolution for the whole distribution necessarily means quasi-static evolution: there is a well defined state at each moment in time. Moreover the components must evolve independently as we cannot learn more about one component by observing its evolution in different combinations: the evolution of the composition is the composition of the evolution. In other words: the evolution must preserve the inner product.
Note that formally there is a strong analogy with the reducible material case. In classical mechanics the state space structure was captured by a distribution over a symplectic manifold. Deterministic and reversible evolution was a transformation that preserved that structure, a symplectomorphism. In the quantum case the state space structure is captured by an inner product space. Deterministic and reversible evolution is a transformation that preserves that structure, a unitary transformation. That is: once we have defined what mathematical structure captures the definition of a state, deterministic and reversible evolution must necessarily preserve such structure.
Proposition IX.8**.**
A deterministic and reversible evolution map for an irreducible material is a unitary operator. That is: where .
Justification. We claim is a unitary operator. Let be two states. with as the composition of the evolution is the evolution of the composition: is a linear operator. as the evolved part of that was prepared like is the part of the evolved that ends prepared like the evolved . We have . . is unitary. ∎
Proposition IX.9**.**
A continuous deterministic and reversible evolution for an irreducible material admits a Hamiltonian operator that allows us to write the laws of evolution as
[TABLE]
Justification. We claim the state evolves according to Schroedinger’s equation. Let be the evolution for an infinitesimal time interval . As it is unitary, it can be expressed as where is a self-adjoint operator. Let be a state and its evolution after an infinitesimal time interval. We have . . ∎
We recognize the Schroedinger equation, the time evolution equation for a quantum particle state.
Note, though, that nothing tells us that the system must be in an eigenfunction of or that the ground state is somehow preferred. In fact, the eigenfunctions of may not be part of and therefore may not be physical. In other words: we have no basis for the time independent Schroedinger equation. This is actually consistent with our assumptions. For example, for a system to reach its ground state it has to be able to radiate energy: it cannot be isolated. Therefore this dynamics cannot be described under the assumption of deterministic and reversible evolution. This already hints that deterministic and reversible evolution is not the only dynamics possible. Other considerations, outside of the scope of this work, can be used to recover this behavior (e.g. thermodynamics, decoherence, …) Weiss .
Also note that operates on which, in the case of , corresponds to the space of Schwartz functions. therefore preserves infinite smoothness and integrability. This, again, reminds us that the space of all self-adjoint operators is far too vast, and does not map well to physically meaningful quantities.
IX.G Time dependence and kinematic assumption
The next step would be to integrate the quantum description with time dependent evolution (i.e. time dependent Hamiltonians and relativistic mechanics) and the kinematic assumption (i.e. Lagrangian mechanics). We will only provide a sketch, though, without going through the details. Given that we are limited to single particles (i.e. no fields) without spin (i.e. minimal material only described by position), our results are limited to finding the Klein-Gordon equation modified with electromagnetic interactions. While this is still of note, the equation is of limited physical use and therefore may not warrant the space necessary for a more rigorous derivation.
As in the classical case, the first thing to do is to extend to include time. This gives us the same as before. A quantum state is a complex valued distribution over a hypersurface at constant time. An evolution is a complex valued function defined on the whole . The operator for the quantity conjugate to time is .
Next we need to extend integration. In the quantum case, this means to make sure the inner product remains unchanged under all variable changes, including time. This allows us to describe the amounts of material and their distribution over fragments in a way that is independent of our description.
As in the classical case, we use as the evolution parameter. Deterministic and reversible evolution will be a unitary transformation defined over this extended inner product, as the structure of the state space is conserved. Continuous evolution will admit an invariant Hamiltonian such that . As for the composite state evolution in the classical case, remains unchanged by the evolution as it transports the distribution along . Therefore is an eigenfunction of . As in the classical case, we use to identify the state space: the temporal d.o.f. is not independent and therefore there is a constraint among the variables. Therefore we have . This is the time dependent evolution equation. It means that the wave function does not change along , the parameter of the infinitesimal transformation generated by .
Note that states are indeed eigenfunctions of the invariant Hamiltonian : here we do have a justification, as opposed to the standard Hamiltonian case. For example, a massive particle may have fragments with different energy, but they all must carry the same fraction of mass. Also note that is basically the form of all equations (i.e. Klein-Gordon, Dirac, Maxwell, …) in quantum field theory. The respective invariant Hamiltonian is the operator associated with each equation.
Having handled the time dependent case, we can turn our attention to the kinematic equivalence assumption. While the trajectory of a fragment is not well defined in either phase space or physical space, what we can describe remains the same under the assumption. Therefore the distributions still need to be transported from state space to kinematic variables up to a constant factor. This means we still have a linear relationship between velocity and conjugate momentum. In terms of the quantum operators: .
This leads to the same form for the invariant Hamiltonian . In the free particle case, we have which is the Klein-Gordon equation. We can also write the operator for kinetic momentum as where is the gauge covariant derivative. We have which is the Klein-Gordon equation with electromagnetic interaction.
Note how the gauge covariant derivative is, up to a constant, kinetic momentum. This motivates why it is such an important operator. As for the Klein-Gordon equation, the only thing it does is to impose that the norm of the four-velocity is the speed of light, a condition much more trivial than one may have anticipated.
It should be clear, even without the details, that all the assumptions come together even in the quantum case. They give more insight to all the pieces in a comprehensive way and help tear down the artificial walls between the different physical theories. This allows us to form a picture of fundamental physics that is more unified, that draws upon a set of common concepts.
IX.H Non-deterministic evolution and the projection postulate
As we made it clear from the start, deterministic and reversible evolution is an assumption. And as we have seen in the rationale for assumptions II and IV we cannot have determinism at all levels of decomposition while transferring information from one system to another.
In this section we will see how non-deterministic processes become necessary when describing measurements for irreducible systems. But we’ll see that, under the same assumption of irreducibility, we are able to make a connection between the output of deterministic and non-deterministic processes.
Suppose we have a quantum particle state we want to identify. Suppose that we have a detector that is able to capture the particle. If it’s captured, we will know that the particle was in the region of space enclosed by the detector.
Suppose that we create an array of such detectors. This will allow us to detect the position of the particle with a resolution given by the aperture of each detector.
Suppose now, though, that the quantum particle state is spread over a region significantly greater than a single detector but smaller than the array. What will happen?
It is clear that it has to be absorbed as it is within the aperture of the whole array. It is also clear that it must be absorbed as a whole system: as it is an irreducible system, the detector cannot partially interact with it, it cannot half absorb it. So a single detector will capture it. It is also clear that it cannot always be the same detector: that corresponds to states where the particle is spread within the aperture of that detector. In other words: as the particle hits the array, one detector triggers non-deterministically based on the distribution of the particle.
The process is non-deterministic in the sense that the state of the particle is not enough to predict which detector will trigger. Maybe it depends on the state or unstated part of the detector, maybe it depends on the unstated part of the particle or maybe on the environment. The point is that a single measurement does not tell us much about the state of the incoming particle.
We then repeat the process, making sure the incoming particle is prepared in the same way. Given a single “pure” incoming particle state, we get a “mixed” statistical distribution describing the output of the array.333333Note that this is different from the model used often to describe the quantum measurement problem, where the incoming system becomes entangled with the measuring device. We do not make any claim on what the final state of the particle should be: in many cases, like in a photomultiplier tube, the particle is gone and there is no state. We simply have one incoming state for the particle, prepared over and over exactly the same, and the outgoing state for the measurement device, which is a classical statistical distribution over the different measurement takes. The question is, how is the statistical distribution coming out of the detector related to the material distribution coming in with the particle?
If the detector does not introduce biases, then the final distribution is only a function of the incoming particle: all unbiased detectors will give the same result. The unstated part also cannot affect the final distribution of outcomes: it is not physically distinguishable. The final statistical distribution of the detector must match the incoming material distribution of the particle. That is if is the total number of takes and is the number of times the detector with aperture in the region captured the particle, the ratio will be approximately the amount of material within the aperture . If we assume an infinite number of takes, we expect them to coincide: . But this is also the frequentist definition of probability. Therefore we have thus recovering the probabilistic interpretation of the wave function.
We can conceptually extend this picture to the generic case. Suppose we know the outcomes of our measurement are parametrized by a fragment variable . We will have a linear functional such that returns the amount of material prepared with the particular value . We can re-express this quantity in terms of the dual vector corresponding to the linear functional and the inner product extended to all Lebesgue integrable functions: . This is also the probability that the outcome associated with is selected by the measuring device, thus recovering the statistical nature of the quantum predictions.
Note that while this process is of a non-deterministic nature, it is of a specific non-deterministic nature. It requires that no other state can influence the final distribution because the match between the physical material distribution and the statistical measurement distribution was recovered only under the assumption that the detector does not introduce any bias. That is: the non-deterministic nature cannot be understood as an averaging over some unknown external state.
Also note that while we have a way to predict the distribution over final outcomes from the initial state, we have no way of describing what happens in between. When we assume that only the initial state matters, we are saying that we can disregard the particulars of the non-deterministic evolution. So much so that we can substitute it with a deterministic one to compute the probability distribution. In particular, given only the initial state, we have no way of predicting which set of final outcomes the system will project to, nor when that projection actually happens, as that depends on the actual choice of detector setup.
While this may seem like an incomplete description, it is as complete as the irreducibility assumption allows. The state can be known and determines any final statistical distribution. The unstated part cannot be known, and is what gives the statistical distribution in the first place. If we were able to say something more about the evolution of the unstated part, we would be able to further describe it, which we cannot do without violating the assumption. If we cannot learn anything about the unstated part from the final distribution, then we are consistent with our assumption and we are able to use deterministic evolution and projection to determine the final statistical distribution. In other words: the inability to describe the unstated part not only constrains the state space and deterministic evolution, but also the set of non-deterministic processes by excluding those for which the final statistical distribution would depend on the unstated part itself.
We therefore have arrived at all the major underpinnings of quantum mechanics and see how they stem from assumption IV of irreducibility. This gives us a more satisfactory account of what quantum mechanics describes, although it does not claim to solve many of the open problems. It does, however, give good reasons as to why we have those problems and how the desire to know “what is really going on” is hindered by the very assumption that the quantum description is based on.
X Discussion and further work
As we went through many details in the derivation, it is time to step back and conclude with a few general remarks.
The first remarkable aspect of this work is that something along these lines can be done. Regardless of whether all the minor details are addressed in the best possible way, the idea that so much can be derived from so little was not something we expected. In hindsight, the idea that physics should be founded on physical principles is nothing new: it just hasn’t been thoroughly applied to basic mechanics. If this work had been done incrementally from the start, these concepts would have been developed gradually and the results would feel more mundane.
The second striking aspect is a shift in perspective that this work seems to suggest. The usual reductionist view is that you start with the rules of the small parts and then build up the composite whole. This work flips that perspective: it’s not what the parts can tell you about the whole, it’s what the whole can tell you about the parts.
The state space for classical particles is the one that allows us to express invariant distributions: that is a requirement that comes from the whole. The fragments of quantum particles do not even have a well defined description: the whole tells us nothing about their configuration. In retrospect, this should not be surprising. Nobody is going to hand us down the laws of infinitesimal parts: we induce what we can by manipulating finite systems. Therefore what the whole allows us to infer about its parts is physically fundamental.
The third notable aspect is that the assumptions have more to do with our ability to create a reliable description rather than essential features of the system itself. A system is not deterministic per se: it is a particular choice for its description (i.e. state) that may undergo deterministic evolution in some cases. In the same vein, a material is not homogeneous per se. Or infinitesimally reducible. In this context, the state, its properties and the laws of evolution are the description of the system under our idealization, not some intrinsic feature of the system.
The fourth intriguing aspect is that, when framing classical and quantum mechanics in this way, there is a progression. First we assume a homogeneous infinitesimally reducible material. Then we assume a homogeneous irreducible material. Extrapolating from this progression, the next assumption would be an inhomogeneous irreducible material: where the material is not in constant equilibrium and its particles do not all look the same.
This different starting point may have potential connections to some of the problems we mentioned in the rationales for the assumptions and to other interesting physics questions in general. In the foreseeable future, however, we will work on the more mundane task of extending this work to field theories, for which a more concrete path is available.
XI Conclusion
We have seen that much of fundamental physics can be derived from few simple physical assumptions. In doing so we obtained a more unified picture of the different branches of fundamental physics centered around the idea of deterministic and reversible evolution of distributions of homogeneous materials. Though the work is extensive we can summarize a few important conclusions with the following points:
- •
A state space is not just a collection of states for the system under study but it must also capture physical properties such as physical distinguishability (represented by a topology), the ability to count states (represented by a measure, symplectic form or metric tensor) or decomposability (represented by a vector space structure).
- •
Deterministic and reversible evolution is a one-to-one map that preserves the nature of the system (e.g. physical distinguishability, state count and decomposability). Therefore it is an isomorphism on the mathematical structure defined by the state space (e.g. homeomorphism, symplectomorphism, unitary transformation), not just a state-to-state bijection (i.e. isomorphism of sets).
- •
Classical Hamiltonian mechanics describes the evolution of a homogeneous material whose state is equivalent to the states of all its infinitesimal parts, the classical particles. The state space for classical particles is a symplectic manifold as this allows us to define state-variable-invariant density distributions; deterministic and reversible evolution for such a state space is a symplectomorphism (i.e. a canonical transformation).
- •
Lagrangian mechanics describes the case where the trajectory in space fully characterizes the dynamics of the system. If we want distributions in phase space to be expressed in terms of kinematic variables (i.e. position and velocity), we find that is a Riemannian manifold and the motion is that of a massive particle under scalar/vector potential forces.
- •
Relativistic motion arises by properly handling time dependent deterministic and reversible evolution for the material (i.e. distributions over phase space) without further assumptions. That is, we derive the geometrical structure of space-time from the geometrical structure of phase space, inverting the typical approach.
- •
Quantum (Hamiltonian) mechanics describes the evolution of a homogeneous material for which the state can only be reduced up to finite parts, the quantum particles, whose internal motion is undetermined. The state space for quantum particles is a complex inner product space ; deterministic and reversible evolution for such a state space is a unitary transformation.
While we are sure that the details of some justifications can be improved, we feel that the overall “conceptual castle” is solid. The starting physical assumptions are simple, the translation into math is often straightforward and the intuitive ideas that emerge help unveil connections within and across different branches of math and physics. It is the tight fitting of these different pieces into a broader picture that validates the merit of the approach.
While the scope of this work is limited to refounding and reunderstanding physical theories already experimentally established, it would not be unexpected for a better grasp of old theories to lead to insights and ideas for new ones.
Acknowledgements.
We’d like to thank Erik Curiel, Stephen DiIorio, Jiahua Gu, Josh Hunt, Isaac Mooney and Pavel Okun for providing feedback on drafts of this manuscript, Mark Greenfield for further insights in the topological aspects and Alan Phillips for contributing figures. We additionally thank Paul Stankus for interest and support in the earlier stages of this project. Funding for this work was provided in part by the MCubed program of the University of Michigan.
Appendix A. Mathematical proofs
In this section we include mathematical demonstrations in support of the physical justifications of the paper.
Theorem A.1** (Extended Riesz theorem).**
Let be a locally compact Hausdorff space. Let a family of positive linear functionals such that and . Then there exists a unique Borel measure such that .
Proof. We claim that at each there exists a compact neighborhood endowed with a Borel measure such that . is locally compact. such that is compact. with the subspace topology is a compact Hausdorff topological space on which is defined a positive linear functional . For the Riesz representation theorem for linear functionals, there exists a unique Borel measure such that .
We claim that is endowed with a unique Borel measure such that . Let two compact subsets. Let . . Also . Therefore . is unique and does not depend on the choice of neighborhood. is locally compact. It admits a cover where each is compact.
[TABLE]
The measure is unique on the whole space. ∎
Theorem A.2**.**
Let . where
Proof. We claim . Let . Let . . . and . . .
We claim . Let . Let . Let . and . . .
We claim . and . ∎
Theorem A.3**.**
Let a symplectic manifold. Let an infinitesimal self-symplectomorphism. Let be the infinitesimal displacement. There exists a function such that and .
Proof. We claim the vector field admits a potential such that . Let be two vectors defined at a point . Let be their components. Let be the pushforward of by . Since is a symplectomorphism we have . The vector components change according to . We have:
[TABLE]
where . The relationship must be true for and pair of vector, therefore . is a curl free vector field and admits a potential such that .
We claim . is differentiable as it is the displacement of a symplectomorphism. The derivatives of are differentiable as . is twice differentiable. ∎
Theorem A.4**.**
Let be a complex vector space. Let such that and . Let and be a family of projections (i.e. linear and ) such that: for some ; ; for some . Then is an inner product space with the product defined by .
Proof. We claim is well defined. Let . as is a projection. for some by the first property of . exists and is unique.
We claim is positive definite. Let . . Therefore and .
We claim is linear in the second argument. Let and . by linearity of . Therefore .
We claim is conjugate symmetric. Let . . Using the second property of the projection we have . The modulus of the product is symmetric as a function of the arguments. Now consider . The product by the third property of the projection. is [math] or . is excluded since . and have equal modulus and opposite phase. ∎
Theorem A.5**.**
Let be the space of differentiable complex functions defined over . Let a differentiable function. Let be a covariant linear operator, that is given an invertible differentiable function . Then for some .
Proof. We claim . Let be the identify function, that is . by covariance. Let be a differentiable invertible function. . Now let be a differentiable function non necessarily invertible. It can be written as with differentiable and invertible. By linearity .
We claim is a derivation. Let be differentiable functions such that . . Multiplying by we have . is a linear operator that satisfies the product rule. is a derivation by definition.
We claim for some . is a derivation. As it is a derivation along , which can be expressed as for some . ∎
Theorem A.6**.**
Let be the space of differentiable and integrable complex functions defined over . Let be a linear adjoint operator of the form with . Let be self-adjoint with respect to the inner product . Then with .
Proof. We claim with . Let . We have using integration by part and integrability of and . as is self-adjoint. . . with . ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Thomas, R. E., Rosa, A. J.: The analysis and design of linear circuits. Wiley (2001)
- 2(2) Barron, R. F.: 8.2 Lumped-parameter analysis. In: Barron, R. F.: Industrial Noise Control and Acoustics. CRC Press (2002)
- 3(3) Borutzky, W.: Bond graph methodology: development and analysis of multidisciplinary dynamic system models. Springer (2010)
- 4(4) Freidin, R., Lasnik, H.: Syntax: critical concepts in linguistics. Routledge (2006)
- 5(5) Friedman, D. P., Wand, M., Haynes, C.T.: Essentials of Programming Languages. MIT Press (2001)
- 6(6) Lee, J. M.: Introduction to Topological Manifolds. Springer (2000)
- 7(7) Halmos, P: Measure Theory. D. van Nostrand and Co. (1950)
- 8(8) Lee, J. M.: Introduction to Smooth Manifolds. Springer (2003)
