Hamiltonian analogs of combustion engines: a systematic exception to adiabatic decoupling
Lukas Gilz, Eike P. Thesing, James R. Anglin

TL;DR
This paper identifies a class of dynamical systems where the usual adiabatic decoupling fails, allowing steady energy transfer across frequency gaps, resembling thermodynamic efficiency constraints.
Contribution
It introduces a systematic class of Hamiltonian systems that violate adiabatic decoupling, enabling steady downconversion through nonlinear resonances.
Findings
Adiabatic decoupling can fail in certain Hamiltonian systems.
Steady energy transfer across frequency gaps is possible.
Efficiency constraints resemble thermodynamic principles.
Abstract
Workhorse theories throughout all of physics derive effective Hamiltonians to describe slow time evolution, even though low-frequency modes are actually coupled to high-frequency modes. Such effective Hamiltonians are accurate because of \textit{adiabatic decoupling}: the high-frequency modes `dress' the low-frequency modes, and renormalize their Hamiltonian, but they do not steadily inject energy into the low-frequency sector. Here, however, we identify a broad class of dynamical systems in which adiabatic decoupling fails to hold, and steady energy transfer across a large gap in natural frequency (`steady downconversion') instead becomes possible, through nonlinear resonances of a certain form. Instead of adiabatic decoupling, the special features of multiple time scale dynamics lead in these cases to efficiency constraints that somewhat resemble thermodynamics.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Hamiltonian analogs of combustion engines: a systematic exception to adiabatic decoupling
Lukas Gilz
Eike Thesing
James R. Anglin
State Research Center OPTIMAS and Fachbereich Physik,Technische Univerität Kaiserslautern,D-67663 Kaiserslautern, Germany
Abstract
Workhorse theories throughout all of physics derive effective Hamiltonians to describe slow time evolution, even though low-frequency modes are actually coupled to high-frequency modes. Such effective Hamiltonians are accurate because of adiabatic decoupling: the high-frequency modes ‘dress’ the low-frequency modes, and renormalize their Hamiltonian, but they do not steadily inject energy into the low-frequency sector. Here, however, we identify a broad class of dynamical systems in which adiabatic decoupling fails to hold, and steady energy transfer across a large gap in natural frequency (‘steady downconversion’) instead becomes possible, through nonlinear resonances of a certain form. Instead of adiabatic decoupling, the special features of multiple time scale dynamics lead in these cases to efficiency constraints that somewhat resemble thermodynamics.
I I. Introduction
433.62pt
I.1 A. Adiabatic decoupling
One of the most basic and broadly applicable principles in all of physics is adiabatic decoupling. It is already familiar from school physics: two weakly coupled degrees of freedom will only exchange substantial amounts of energy if their resonant frequencies match. In more sophisticated language, adiabatic decoupling means that the effects of fast degrees of freedom on slow degrees of freedom can be described by renormalizing the effective Hamiltonian which governs the slow time evolution. Applications of this principle range from the Born-Oppenheimer approximation in molecular physics Born_Beweis_1928 ; Born_Zur_1927 to effective Langrangians and renormalization in quantum field theory Weinberg ; Shankar_Renormalization_1994 ; Berges_Non_2002 . Whether the fast degrees of freedom in question are gluons in nuclear matter, atomic excitations, or vibrations in a rigid body, it is thanks to adiabatic decoupling that we can ‘adiabatically eliminate’ or ‘integrate out’ high-frequency modes, to leave an effective Hamiltonian which describes only slow variables, and yet describes them accurately, even over long times.
While the power of adiabatic elimination is often celebrated, its most basic implication is less frequently noted: since the slow evolution is Hamiltonian, it conserves energy. Fast degrees of freedom cannot steadily inject energy into the low-frequency world. Or can they?
I.2 B. Steady downconversion
Consider the case of combustion engines. These are such large and complex dynamical systems that they must in practice be described thermodynamically, rather than in microscopic terms. In principle, however, a real engine could still operate within a sealed container, at least for some time, as long as the container were large enough to include air, exhaust, and so on. The operation of a combustion engine is thus in principle a case of closed-system Hamiltonian time evolution. What a combustion engine nonetheless does, however, is to extract energy steadily from chemical degrees of freedom, whose dynamical time scales are on the order of femtoseconds (frequencies Hz), and then ultimately use this energy to turn wheels at a few thousand revolutions per minute ( Hz). If we introduce the term steady downconversion to mean this kind of steady transfer of energy across a dynamical frequency gap, precisely as is normally forbidden by adiabatic decoupling, then steady downconversion across a frequency ratio of is in fact achievable, albeit in dynamical systems too large and complex for microscopic description.
I.3 C. Microscopic models
The question of exactly how it is that macroscopic engines manage to evade adiabatic decoupling, and achieve steady downconversion, leads quickly into the general question of how thermodynamics ‘emerges’ from mechanics in the limit of large system size. Much has been learned about that emergence, however, by starting from the microscopic side of the limit. The main goal of such work has hitherto been to learn how the ensembles of statistical mechanics can be justified by effective ergodization within Hamiltonian mechanics. As a fine example of this kind of study, we are inspired by the classic work of Chirikov, in showing how a not-too-small perturbation of an integrable system can break the invariant tori of Kolmogorov-Arnold-Moser theory Arnold_MMoCP_1989 and lead to effectively ergodic behavior Chirikow_1979 .
In particular, Chirikov presented instructive models of nonlinear oscillation, and showed how certain resonant perturbations can induce Arnold diffusion Chirikow_1979 , even in systems with few degrees of freedom. In the present paper we take a similar approach, to the point of studying some quite similar Hamiltonians. The significant differences that we will introduce, however, will reflect a quite orthogonal perspective: our concern is not information, but energy. Instead of aiming to understand the effective loss of information that is represented in statistical mechanics by ensembles, we will focus on steady downconversion as a mechanical analog to the conversion of energy-dense fuel into work, as in a combustion engine. Our basic question is therefore: In a phase space of only a few dimensions, what kind of Hamiltonian system can exhibit steady downconversion?
I.4 D. Hamiltonian ‘daemons’
Because our central concern is thus secular energy transfer between slow and fast degrees of freedom, it is an important restriction that we will further insist on a time-independent Hamiltonian, so that the system conserves its total energy and no important energetic behavior is ‘put in by hand’. This restriction to time-independent Hamiltonians means that although we are only seeking a sort of minimal toy model for a combustion engine, yet in an important way our quest is more ambitious than most theoretical models for microscopic engines: we do not allow the kind of macroscopic elements that are represented by external control parameters (which would make the Hamiltonian time-dependent) or by heat reservoirs (which would make the evolution non-Hamiltonian).
The kind of system we seek can thus be thought of as a sort of mechanical Maxwell’s Demon — except that instead of being directed against the Second Law of Thermodynamics, the principle it contrives to violate is that of adiabatic decoupling. It is also an important difference that our small Hamiltonian systems constitute our entire systems of study, and are not, like Maxwell’s Demon, small additions to macroscopically large systems. Insofar as we are considering microscopic analogs of engines, we are considering entirely microscopic analogs, not just microscopic working parts which extract energy from macroscopic heat baths. In our discussion at the end of this paper we will briefly compare this kind of isolated small system with systems coupled to baths.
To suggest the kinship of our systems with the Demon, while also acknowledging the important differences, we will refer more briefly to “small dynamical systems with time-independent Hamiltonians which exhibit steady energy transfer from fast to slow motion” as Hamiltonian daemons. The first question of our paper is then: Do daemons exist, mathematically? The answer can be seen from Fig. 1.
I.5 E. An example of a daemon
What Fig. 1 shows is the position (upper plot) and velocity (lower plot) of a certain point mass, which moves in time (horizontal axes) under the canonical equations of motion generated by the Hamiltonian (1), which we will present in Section II and then analyze for the bulk of this paper. Two other oscillators are also coupled in (1) to the point mass, but are not represented in the Figure.
In Fig. 1 what we see is that oscillates harmonically for a couple of periods, indicating that the point mass is moving in a quadratic potential. This point mass is also subject to other forces, however, and is not simply a harmonic oscillator, because after a few oscillations, it suddenly begins a ‘driving phase’ of motion at nearly steady velocity, as if an engine had been turned on. After some time of this nearly steady motion, abruptly resumes harmonic motion, and at a much larger amplitude than it had initially; something has done a lot of work on the mass during the driving phase of motion. In fact this work has come from the system’s other two oscillators, which evolve on high frequencies. Small effects of these coupled high-frequencies are shown, in the insets of FIg. 1b), in the otherwise steadier speed of . The remarkable feature of Fig. 1, however, is a much more dramatic effect of the coupling of to the high-frequency oscillators. During the driving phase of motion, when stays nearly constant, the high-frequency part of the system steadily transfers energy to .
Figure 1 is thus a proof by example that daemons are allowed by the laws of mechanics precision . We will further show that daemons are a general class of dynamical systems featuring three distinct time scales, and that they obey certain non-trivial constraints, which are in some respects reminiscent of the laws of thermodynamics. We will approach these general points by first explaining the particular system of Fig. 1.
II II. A Hamiltonian Daemon
II.1 A. The Hamiltonian
The Hamiltonian for the system of Fig. 1 is
[TABLE]
with the particular values , , , , , , . Since does not depend explicitly on time, it is conserved. The work done on the mass depicted in Fig. 1 is drawn from the initial energy of the oscillator, though the high frequency which actually matters dynamically in this system is really the difference . The quantitative parameters of this model were chosen for illustrative purposes; the system’s behavior is not qualitatively sensitive to their precise values precision .
Secular energy transfer in is non-trivial: if we let we would simply have three harmonic oscillators, and even with the nonzero value of that we actually have, their three frequencies all differ by much more than the frequency scale associated with the coupling between them. From this one would normally deduce adiabatic decoupling: to zeroth order in the three co-ordinates should simply oscillate, and do so at greatly different frequencies, so that the coupling term would be not only small, but rapidly oscillating, and hence it should average to zero and have no significant effect of any kind. Beyond zeroth order, energy exchange would indeed occur, but it would be small in amplitude and high in frequency, with no net long-term (secular) effect. This kind of adiabatically decoupled behavior is indeed seen in Fig. 1 before and after the driving phase, but the driving phase defies the expectation of adiabatic decoupling.
The expectation of adiabatic decoupling in this case is based on the assumption that a weak coupling, such as we have, can only have substantial effects if it is also resonant. In linear dynamics, resonance means frequency matching, and since our three oscillators’ frequencies are badly mismatched, linear dynamics would imply adiabatic decoupling. Weak but highly nonlinear couplings, however, may be resonant after all, at least in some regions of phase space, even across large frequency gaps. This is the kind of exception to adiabatic decoupling that our daemon exploits.
II.2 B. Adiabatic decoupling vs. nonlinear resonance
Numerical solution of the equations of motion for in fact confirms that adiabatic decoupling is the case throughout most of phase space. The coupling term in is a highly nonlinear function of , however, and this provides a nonlinear loophole in adiabatic decoupling. A special case occurs when happens to be rising or falling at close to the critical speed . In this circumstance, is not just rapidly oscillatory, so as to average to zero, but includes a component which changes slowly. Whenever , therefore, the coupling may indeed have a more significant effect, at least for the short time during which the speed remains close to explains .
An effect that is only significant for a short time is not really very significant, however; it would not count as an exception to adiabatic decoupling, which is about long-term behavior. But this is our key point, because as we will see below, when is near , the significant effect of the coupling can be to keep near . So instead of a transient perturbation, the nonlinear resonance at can induce a transition to a new dynamical phase — the driving phase. As Fig. 1 shows, can remain close to for a long time, until the slow mass has gained a large amount of potential energy from its steady climb up the harmonic potential .
II.3 C. Canonical transformation to
To see how the daemon works, we will apply canonical transformations and adiabatic approximations to transform into a series of effectively equivalent . The first step is a canonical transformation to Hamilton-Jacobi variables , for the two fast oscillators:
[TABLE]
If we then discard small terms that play no significant role in the Fig. 1 evolution because they are never resonant for near (see our Appendix for details), we obtain the adiabatic effective Hamiltonian
[TABLE]
Since the angle variable does not appear in , its conjugate momentum is a constant of the motion under the adiabatically approximate evolution generated by (hence an adiabatic invariant in the exact evolution). We may therefore consider as a constant, whose value is given by , in the Hamiltonian evolution of , , and . Inverting (II.3) yields in the case of Fig. 1.
II.3.1 Comparison with a Chirikov resonance
(Readers who are not interested in the relationship between our model and an isolated Chirikov resonance may skip directly to the next subsection.)
The coupling term in of (II.3) is now similar in mathematical form to the simplest case (an isolated resonance) of the resonances studied by Chirikov in Chirikow_1979 . One apparently significant difference, however, is that our is a canonical variable, which evolves under the time-independent Hamiltonian of the total system, whereas the corresponding variable (also called ) in Ref. Chirikow_1979 is simply a multiple of the time, and appears as the argument of a sinusoidally time-dependent external perturbation. This difference is not really as sharply qualitative as it might seem, though, because as Chirikov points out, a fixed time dependence of the form can always be regarded as the evolution of a dynamical variable like our own , if a term linear in ’s conjugate variable is added to the Hamiltonian. As long as appears nowhere else in the Hamiltonian, then, the equation of motion for will simply be .
With this understanding (and after minor adaptations of notation) we can therefore express the Chirikov Hamiltonian of Eqn. (3.15) in Ref. Chirikow_1979 as
[TABLE]
where and are canonically conjugate pairs. Thus the first difference between our model and Chirikov’s is that the factor which multiplies our cosine coupling depends on instead of . We will see in Section IV, below, that this dependence on is important in ensuring that the daemon’s downconversion must eventually cease if is bounded from below (i.e. our fuel source is finite). For the ongoing operation of the downconversion mechanism, however, this detail of coupling dependence on is not really significant, because our will only change slowly.
The most basic difference between our and the above , in fact, is that in the slow variable which is coupled to the fast does not appear in , which depends only on the conjugate variable . In our case, in contrast, the variable coupled to is , and the slow mass’s own Hamiltonian includes not only a term that depends on its conjugate, (namely the kinetic energy ), but also a term that depends on itself (the slow-sector potential energy ). As we will explain just below, the precise form of this potential term in our model is not important for the downconversion mechanism; all that really matters is that we have a sufficiently slowly varying potential . In this sense the Chirikov resonance is a degenerate case of our daemon model, in which happens to vanish. As we will see further on in this Section, the existence of a non-trivial potential term makes a qualitative change in our model’s dynamics, in comparison with that of the isolated Chirikov resonance which our model otherwise resembles. The additional potential term introduces an additional time scale, and the phenomena that occur on this long additional time scale are the main subject of this paper: the long additional time scale corresponds precisely to the rate of steady downconversion. In the Chirikov limit , this rate goes to zero.
II.4 D. Slowly varying potential
The harmonic potential changes only very slightly over the period of the rapid oscillations in that occur during the driving phase. We can therefore understand the dynamics in this phase by replacing the harmonic potential with a linear potential whose slope is constant, and then after this simplified problem has been solved, replacing with the slowly changing slope of the actual harmonic potential. This yields
[TABLE]
In fact we could apply a similar procedure to replace any sufficiently slowly varying , not necessarily quadratic, with an instantaneous linear potential whose slope changes slowly in comparison with the time scale that is relevant for the downconversion mechanism. We have confirmed with numerical solutions of such nonlinearly modified alternatives to that this procedure accurately approximates the exact evolution.
II.5 E. An explicitly time-dependent invariant
We now reach a crucial point in daemon dynamics. Linearizing the harmonic potential of has given the new Hamiltonian a first integral:
[TABLE]
is constant (even though it depends explicitly on !) under the evolution generated by . In the adiabatically decoupled phase, stays constant by having and ; in the driving phase it is constant because and . For the evolution shown in Fig. 1, .
Using the first integral we can reduce to a single non-cyclic degree of freedom by a further canonical transformation from to , with and . With the explicit -dependence of , this is a time-dependent canonical transformation, and the transformed Hamiltonian which results Goldstein is
[TABLE]
Since is constant, we can now treat as a time-dependent Hamiltonian in the two-dimensional phase space . Note in comparison that a pure Chirikov resonance, with as in above, would have a time-independent Hamiltonian in place of , as in the ‘resonance Hamiltonian’ of Eqn. (3.18) in Ref. Chirikow_1979 .
II.6 F. A ‘tilted washboard’ model
Finally, the -dependence of can be important during the dynamical transition from decoupling to driving, but during bound motion the kinetic term in must necessarily be smaller than the depth of the local potential minimum, and so . This means that the proportional contribution of within is . We can therefore understand both the driving and decoupled phases by neglecting in , obtaining for our final approximate adiabatic Hamiltonian simply that of a single particle in a time-dependent potential:
[TABLE]
We emphasize that the time-dependent effective potential which appears in the final approximate is not the same as the original slowly varying external potential from the full and exact . See our Appendix for numerical confirmation that accurately reproduces the exact evolution under , as shown in Fig. 1, except for oscillations on the short time scale.
Inserting the adiabatic time dependence reveals that the rate in as just defined is of order throughout the evolution shown in Fig. 1. This is by far the lowest rate or frequency in the entire evolution. The effective potential can thus be considered adiabatically, by understanding the motion implied by for fixed , and then allowing the parameters in that motion to change slowly with . For any fixed , has the form of a tilted sinusoidal ‘washboard’; see Fig. 2. The two dynamical phases of are then finally clear: for most orbits the slight undulations of the potential are insignificant (adiabatic decoupling), but as long as the washboard tilt is not too great, there exist local minima in of , about which bound motion is possible in the surrounding local potential well.
When thus oscillates around zero, oscillates slightly around , and hence oscillates slightly around the steady speed , as seen in Fig. 1 for (the driving phase). (These small oscillations of in the local well of are the intermediate-scale oscillations seen in the upper inset of Fig. 1b).) The crucial point is that by maintaining the mass’s speed near , the rest of the system steadily does work on the mass, by raising it steadily against the or potential. This is how the daemon performs steady downconversion.
II.7 G. Self-sustaining resonance
The simple picture of effective particle motion that we finally reached in does let us understand the daemon’s driving phase in familiar terms, but only through the rather abstract variables that emerged after a series of transformations and adiabatic approximations. The Hamiltonian daemon represented by is not a trivial system.
One somewhat more physical way to understand the real nature of the steady downconversion mechanism is to consider it as a nonlinear version of the ordinary kind of resonant energy transfer, with the special nonlinear feature being that the resonance only holds for close to . As usual, therefore, energy transfer will be most efficient at exact resonance, which occurs when is exactly . The mass might therefore rise stably at a speed just above , so that if it were to decelerate, transfer efficiency would rise and the additional force would speed the mass back up. Conversely, if it were to accelerate, transfer efficiency would fall, and the mass would slow down. The nonlinear resonance can therefore be self-sustaining.
This effect is an example of what is generally known as nonlinear stabilization Chirikow_1979 ; but the effect of the stabilization is here somewhat different from usual. Ordinarily what is meant by nonlinear stabilization is that nonlinear effects prevent the secular transfer of energy between degrees of freedom. In a Chirikov resonance as described by in (4) above, for example, a linear would mean that resonance () would obtain, or not obtain, throughout the whole phase space uniformly, depending only on the fixed parameters in the Hamiltonian (namely and ). If resonance does hold, therefore, the special case of linear allows complete transfer of energy from to . As well as being special, the case of linear is only a degenerate case of downconversion, because the designation of as fast and as slow is in this case arbitrary: one could give the two oscillators the same frequency by the canonical rescaling , for .
If in is nonlinear, however, then the resonance condition will generally only hold for a particular value of — just as in our case the quadratic kinetic energy means that resonance occurs only at . If is then increased in the Chirikov model, due to resonant transfer from , resonance no longer holds, and transfer stops. The result in the Chirikov model is that can then only oscillate around the resonant value, with an amplitude limited by the strength of the cosine perturbation amplitude ; the nonlinear stabilization prevents the secular transfer of energy from to . In our case also the resonant transfer phase of evolution (the driving phase) sees only small oscillations of around the resonant value , and the amplitude of these oscillations is limited by our interaction strength . Since our slow mass’s energy also includes a potential term , however, the nearly steady maintenance of means that the potential energy steadily increases, through resonant transfer from . In our daemon model, therefore, the nonlinear stabilization of therefore means precisely that secular energy transfer is not prevented, but sustained.
This is the basic mechanism of steady downconversion in Hamiltonian daemons like the one described by our . The important consequence is that total energy transfer from to the slow mass is not limited by the strength of the coupling term, but by the total amount of available (and by other constraints due to the slow -time-scale time dependence of , to be described below). The strength of the coupling term does limit the daemon’s performance; but it limits it rather in the way that a car engine’s performance is limited by its maximum torque output. A car whose engine is too weak cannot climb too steep a hill. If the torque suffices for the hill’s steepness, however — corresponding here to the tilt of being gentle enough, in relation to the well depth, that local minima still exist — then the car can keep driving uphill until it runs out of fuel.
III III. Generic Daemons
The (mathematical) existence of Hamiltonian proves that Hamiltonian daemons exist. How representative is of daemons in general? In a word, broadly. It is representative of all daemons whose slow ‘work’ degree of freedom is powered from high-frequency ‘fuel’ that is not in itself chaotic, and which exploit isolated nonlinear resonances. For all such systems, the high-frequency sector can be represented without loss of generality with Hamilton-Jacobi co-ordinates , plus as many additional co-ordinates as may be needed for all the high-frequency degrees of freedom. Since the Hamilton-Jacobi construction makes the time-independent under the evolution generated by alone, the can only evolve under the Hamiltonian terms which couple to the slow degree of freedom. These terms have to be small, because we can only identify the slow and fast degrees of freedom as such by overlooking their coupling on the grounds that it is weak. The variables will therefore evolve slowly under the full daemon , and so considerations of resonance and adiabatic invariance like those applied to will also lead, for a large class of daemon systems, to explicitly time-dependent adiabatic invariants like , and thus to time-dependent effective Hamiltonians of the forms of and . The potential function may be different in its dependence on as well as on , and it may have further slow time dependence through its dependence on variables. The basic scenario, of steady downconversion maintained by cyclic orbits in an effective potential, will remain the same.
In particular it is interesting to note that daemons are generically dynamical systems with at least three important time scales. By their definition they have an important short time scale, analogous to in . Also by the definition of steady downconversion, they must have a much longer time scale, analogous to in , over which the high-frequency energy is transferred into slower motion. The steady slowness of this transfer is ultimately also due to the smallness of the interaction between the slow and fast subsystems; if it were not so slow, then the energy transfer would not really be analogous to the steady downconversion of an engine, but to the explosively non-steady downconversion of a bomb.
It is the intermediate third time scale which is surprising here: the period of effectively bound motion during the driving phase, as shown in the upper inset of Fig. 1b. The generic requirement for (adiabatically) periodic motion of this kind is clear from the nature of dynamical stabilization: Hamiltonian systems maintain a steady average speed by oscillating around it. If we label the oscillation frequency with , then the weakness of coupling must imply , while the steadiness of downconversion implies . Daemons are thus examples of multiple-time-scale systems in which three distinct time scales are simultaneously important. Whether by coincidence or not, the essential feature of steady periodic motion in a daemon’s driving phase is analogous to the cyclic operation of a macroscopic engine. We represent this fact provocatively in Fig. 3 by comparing , , and to the analogous rate scales of a motor.
Daemons are thus a large class of systems, but very many of them can be mapped onto systems similar to the one presented here. The exploration of possible exceptions and generalizations must be left for future work. Here we will turn instead to examining an important general feature of daemons which can also be understood from the behavior of . How and why do daemon driving phases end?
IV I.: Efficiency Limits
IV.1 A. Energy conservation
The explicit slow time dependence of is not any kind of heuristic modification of the system dynamics, but is due entirely to the time-dependent transformation which replaced with . That step, which produced from the time-independent , was an exact canonical transformation. Since as a result is explicitly time-dependent, it is not conserved; but the original energy still is conserved. Indeed is time-dependent precisely because is conserved, since the explicit time dependence of the adiabatic invariant reflects the fact that if remains (nearly) constant despite the external force , then must decrease steadily to supply the needed power . It should therefore be no surprise that it is the slow time dependence of in which makes the daemon stop driving when it runs out of ‘fuel’. And analogous phenomena will be observed in any analogous daemon system.
In fact the daemon must in general stop before it consumes all its . Whether because the washboard tilt increases, or because the washboard well depth eventually decreases, at some time there will no longer be any local minima in . No bound orbits, and hence no steady downconversion, can continue past , even if has not yet been drained to its ground state. At the minimum value , the well depth is zero; but with finite , will become a bumpy slope with no minima before the washboard completely disappears. A similar consideration will apply to any daemon whose effective Hamiltonian is adiabatically similar to .
IV.2 B. Efficiency limits from adiabaticity
Except for a zero-measure set of initial conditions, moreover, daemons must stop driving, and revert to adiabatic decoupling, even earlier than their . This more stringent limit on Hamiltonian work extraction from high-frequency energy is the subtle inherent weakness in steady downconversion. The daemon can run for a long time, because it drains its fuel slowly: is slow. But this means that, in the driving phase, the area that is enclosed in phase space by the periodic orbits of bound motion is an adiabatic invariant Goldstein . At any , any local well of will have a highest bound orbit, and the area which it encloses in the plane will be the largest that the local well can support at that time. For any steady downconversion trajectory, therefore, the orbit’s enclosed area will remain constant (adiabatically, i.e. up to small, fast oscillations), while the maximum area which the well can support will eventually fall towards zero. After the time , when has fallen to , the bound orbit with area can no longer continue, and the dynamical transition to adiabatic decoupling must occur. See Fig. 4.
The adiabatic invariance of thus sets a limit on how much high-frequency energy a daemon can convert into work, which is in general lower (and as Fig. 4 shows, possibly much lower) than the limits set by energy conservation, or by the maximum force that can be exerted by the coupling term in . This limitation is moreover inevitable, because it is inherent in the time scale hierarchy that defines a daemon, as sketched in Fig. 3. This generic daemon time scale hierarchy means that must be adiabatically invariant, and limit the duration of steady downconversion to be less than what would be allowed by conservation of energy alone.
V V. Outlook to Microthermodynamics
The main result of this paper has been to prove by example that Hamiltonian daemons are in principle possible; small dynamical systems can sustain steady energy transfer from rapid motions to slow. We have also found a non-trivial limit on the amount of work that our example daemon can do, and as we have argued that our example daemon is a representative example of a large class of daemon systems, we have shown that this kind of efficiency limit is a generic feature of steady downconversion in small Hamiltonian systems. Small dynamical systems have traditionally been studied as toy models for more general phenomena, however. Since the behavior of daemons is at this level analogous to that of combustion engines, and since heat is after all fundamentally nothing but a certain rapid ‘kind of motion’ Clausius , we close our paper by discussing the possible implications of our results for the microscopic roots of thermodynamics.
V.1 A. Daemons and thermodynamics
The fact that Hamiltonian daemons can in general do less work than the limit allowed by energy conservation, because a certain phase space volume cannot decrease, is reminiscent of the thermodynamic limits on heat engine efficiency, which not only insist on conservation of total energy, but further say that not all energy is thermodynamically ‘available’ for conversion into work, because entropy cannot decrease. In the statistical mechanics of the microcanonical ensemble, entropy is identified with (the logarithm of) a certain phase space volume (namely, that volume which is ergodically explored by the system as it undergoes chaotic evolution). It is therefore intriguing to speculate whether the mechanical constraints on Hamiltonian daemons, in which conservation of certain phase space volumes limits energy transfer, may perhaps be related somehow to the constraints of thermodynamics, whose microscopic origins remain obscure.
Further investigations can moreover demonstrate additional analogies between daemon mechanics and thermodynamics, in the constraints on daemon ignition, and in entanglement growth in quantum mechanical daemons; these results are reported elsewhere paper2 ; paper3 . These analogies may even prompt an alternative hypothesis to the long-standing assumption that thermodynamics somehow ‘emerges’, at mesoscopic scales, from non-thermodynamical microphysics. The alternative is that perhaps thermodynamics doesn’t begin at mesoscopic scales, but simply persists into macroscopic scales from microscopic mechanics, where it already exists in embryonic form as the set of dynamical constraints upon steady downconversion.
On the other hand we must note that all the constraints on Hamiltonian daemons obtain within closed-system Hamiltonian mechanics, even without chaos or disorder. While the constraints on daemons may therefore resemble thermodynamics in their practical consequences, the reasons why the constraints apply would seem to be different. For the constraint that we have identified in this paper, for example, the difference between statistical mechanical entropy and the adiabatic invariant is drastic in a basic respect: the phase space area involved in limiting daemons does not represent a volume that is ergodically explored by the system. The system’s orbit under encloses the area , but it does not even enter the area , let alone ergodically fill it. The concept of ergodic filling is fundamental in statistical mechanics, and if ergodic filling is really irrelevant to the mechanical constraints on steady downconversion, then the relationship between limits on daemons and thermodynamics may go beyond statistical mechanics itself, and lead either to an extension of thermodynamics into smaller systems (‘microthermodynamics’), or the embedding of thermodynamics within a larger class of analogous constraints.
V.2 B. Daemons and baths
Should we really be certain, in any case, that statistical mechanics is the whole story of how thermodynamics emerges from mechanics? Statistical mechanics is based on introducing ensembles to provide ‘coarse-grained’ descriptions, which contain no information about any aspects of time evolution that are rapidly ergodic. In this sense the first question that statistical mechanics addresses is about the exchange of information between fast and slow variables, and its first answer is that equilibration occurs: information can be effectively lost from the slow sector, even though the total evolution is Liouvillian (or in quantum mechanics, unitary). Questions about energy exchange are then most often treated in a second step, in the sense that one studies energy transport under local (but not global) equilibrium, or postulates ‘baths’ or ‘reservoirs’ as sinks or sources of energy that always remain in equilibrium.
Active research continues into how information can thus effectively be lost within deterministic time evolution, and the physics of information is a major topic in general. By no means do we question the profound importance of information in physics; but we would argue also for the alternative approach, of considering energy exchange as the first question, instead of equilibration. Thermodynamics is after all a practical discipline, and engines do not exist to equilibrate, but to perform large amounts of steady work from compact fuel.
There is a basic physical reason why extracting large amounts of work from compact fuel demands downconversion: the units of energy are Mass (Length)2 / (Time)2, and so a source of energy which is rich in comparison to its size and mass must possess a short time scale. It may therefore be worthwhile, as a kind of second front in the struggle to understand the microscopic roots of thermodynamics, to re-phrase the basic question. Instead of asking How can steady work be extracted from the equilibrated degrees of freedom of a heat bath?, we can ask How can steady work be extracted from high-frequency degrees of freedom? Further investigations of Hamiltonian daemons and related systems may thereby shed further light on thermodynamics.
Understanding Hamiltonian daemons may potentially even be practical. Chemical reactions are a ubiquitous source of this kind of dense energy, and the general problem of transferring their high-frequency energy into much slower motions is one that is not only solved macroscopically by engines, but also (somehow) by living organisms, on much smaller scales. Whether dynamical limitations on steady downconversion in small systems prove to be a microscopic limit of thermodynamics, or whether they turn out to be a parallel set of constraints, they may conceivably be of comparable importance to thermodynamics, for molecular machines biomotor2 .
Of course natural molecular machines are not isolated systems as daemons are, and any future artificial microscopic machines will also have to tolerate dissipation and noise if they are to be useful. We have only defined daemons as isolated, however, in order to ensure that they do not need external power in order to operate. The adiabatic mechanisms by which daemons operate are normally quite robust, and so a generalized daemon, which was subject to dissipation and noise from its environment, might still very well function. If so, the processes of self-contained steady downconversion as by daemons, and work extraction from baths as by heat engines, may prove to be alternatives that are compatible — or even to be alternative limits of a single phenomenon.
VI Acknowledgements
We thank our colleague Martin Strzys for suggesting ‘microthermodynamics’ as a name for the hypothesis that thermodynamics extends, in some non-trivial form, to small systems. LG acknowledges funding from the German Excellence Initiative (DFG/GSC 266).
VII Appendix: Accuracy of as an adiabatic approximation to
VII.1 Non-resonant terms discarded to obtain from
A crucial step in our main text’s chain of effective Hamiltonians is discarding non-resonant terms from . Without discarding them, the canonical transformation to Hamilton-Jacobi variables would instead have produced from the canonically equivalent Hamiltonian
[TABLE]
The four terms in will then be resonant for (first two terms) and (last two terms), respectively. Non-resonant terms can be neglected, because of adiabatic decoupling; this is essentially the so-called “rotating wave approximation” of quantum optics. Since the only non-trivial motion that occurs in the trajectory shown in Fig. 1 involves , the first three terms can be discarded, as far as this motion is concerned. This leaves us with from Eqn. (3) of the main text. The accuracy of this rotating wave approximation, and of the other approximations which lead from to , may then be assessed directly, by numerically solving the equations of motion for both Hamiltonians.
VII.2 Accuracy of as an approximation to
To compare evolution under the explicitly time-dependent adiabatic effective Hamiltonian to the full evolution under the original time-independent Hamiltonian , we must relate the coordinates to the original coordinates. Note that and are exactly canonical, even though non-resonant terms have been dropped between and so that is only approximately equivalent to . The momentum transformation is just a translation: . After inverting Eqn. (2) to obtain in terms of we find to be
[TABLE]
where is defined to be positive. (It turns out that in the driving phase lags slightly behind , so that is negative; hence the overall minus sign.) From the above coordinate mappings we can therefore compute the exact from the numerical solution to the full equations of motion for all six original canonical coordinates under , as plotted in Fig. 1, and compare this to adiabatically approximate evolution of and alone under . We will refer to these solutions as and , respectively.
To obtain , we must first determine explicitly by supplying the correct slowly-varying external force. The initial conditions of Fig. 1 provide
[TABLE]
The daemon begins steady downconversion at around — the transition is by definition not something that can occur at one precise instant, because it is a change from non-periodic to periodic motion in the plane, and the exact moment within the first period at which the motion first becomes periodic is not well defined. We can, however, extrapolate the nearly constant slope of , during the driving phase, back to the time at which would have been zero if the driving phase had begun from zero . We therefore deduce the adiabatically approximate
[TABLE]
This yields
[TABLE]
Adiabatic effective Hamiltonians like are in general determined by decomposing the exact evolution into a sum of slow and fast parts: , for example. Where adiabatic methods are warranted, this decomposition remains valid over long times, and the fast term remains small in amplitude, as well as high in frequency, whereas the slow part may slowly change by large amounts. The goal of adiabatic methods is to discard the fast parts like and describe accurately, over long times, with simpler equations; even with ample experience it is astonishing how well this can work. A subtlety which is sometimes overlooked in deriving adiabatic methods, however, is that the initial conditions which must be used for the adiabatic approximate evolution, in order to match the slow part of the exact motion, are generally not the same as the exact initial conditions, because the exact initial conditions represent the sum of the initial values of both fast and slow components. Slightly perturbed or renormalized initial conditions must therefore be used in the adiabatic approximation. Since the full and exact initial conditions determine the entire evolution, the correct adiabatic initial conditions can be derived as particular functions of the exact initial conditions; but it is usually easier simply to determine the adiabatic initial conditions by fitting the first few periods of adiabatic evolution to the exact evolution. The magic of adiabaticity is that this initially fitted approximation will then remain accurate for a long time.
For the evolution shown in Fig. 1 we solve the canonical equations of motion derived from , from the initial time , shortly after the daemon’s driving phase has begun. (The adiabatic method does not work as well right around the dynamical transition, where post-adiabatic effects are significant and other methods must be applied.) By tuning the initial values to and , we can achieve the good agreement shown in Fig. A1 between evolution and the exact evolution with the initial conditions of Fig. 1 (which applied at ), over the early time window .
We can then see how well this adiabatic solution tracks the exact evolution at later times. To do this, we are not allowed to retune the initial conditions for each later time period; we must keep the same initial conditions at , and see what they imply for later. Adiabatic evolution is not normally good, however, at following the exact phase of periodic motion over long times. Time translation is a zero mode, and the time coordinates of the exact and approximate solutions tend to drift slowly out of synchronization. We can therefore compare with , with a new fitting parameter than is allowed to vary slowly in time. The agreement in phase that we then obtain, between exact and adiabatic solutions, is merely due to fitting; but the agreement in amplitude, and in all other slow features of the periodic motion, is non-trivial — indeed, remarkable. Over the long times that we investigate, the amplitude and frequency of both slow and fast components of the motion all change substantially, but the adiabatic approximation tracks the slow amplitudes and frequencies extremely well. See Fig. A2.
VII.3 Adiabatic invariance of under evolution
As well as being derived from as an adiabatic effective Hamiltonian, is itself a good target for adiabatic theory, because its explicit dependence on is very slow compared to the frequency of the bound orbits it describes during steady downconversion. The slowness of the -dependence of the functional form of naturally suggests an approximation based on the fact that remains nearly the same function over several periods. And indeed one can confirm that the instantaneous value for a particular trajectory changes only slightly, over several periods. The changes in do not remain small over long times, however; changes slowly, but it slowly changes by a large amount. When a Hamiltonian like is a slowly time-dependent function, the adiabatic theorem states that the quantity which remains nearly constant over long times is not the value of the Hamiltonian, but rather the action .
The action is defined for any fixed and value to be the area in the phase space plane which is enclosed by the closed curve which satisfies . In our main text this action is computed and plotted in Fig. 4, for two different exact trajectories under . For each trajectory the corresponding adiabatic are determined by initial fitting, as described above. For each of the two trajectories shown in Fig. 4, the value is computed from the initially fitted , and then the corresponding enclosed phase space area is computed by numerical integration. (No subsequently fitted time shifts are employed in these computations, because is a slowly varying function that is not sensitive to short time translations.) The plotted are indeed close to being constant, until the transition to adiabatic decoupling occurs as explained in the main text.
As the inset in Fig. 4 shows, however, is not an exact constant of the motion. As an adiabatic invariant, it exhibits small and fast oscillations around an average value that remains constant over a long time. For this reason the time at which steady downconversion ceases is not only intrinsically ill-defined within a period; it is impossible to predict from slow variables alone, because once the bound motion is only barely bound, a small post-adiabatic correction may be enough to let the system escape across the adiabatic separatrix into unbound motion. This adiabatic uncertainty in the precise time at which the daemon will stop working can easily be a very small fraction of the total duration of steady downconversion, however. For daemons whose time scale ratios and are large, the significance of post-adiabatic corrections compared to adiabatic results may be comparable to the importance of thermal fluctuations relative to equilibrium thermodynamics in macroscopic engines.
The dashed line in the main text’s Fig. 4 represents the same function , computed for a slightly different trajectory , corresponding with the same adiabatic kind of accuracy to a different exact trajectory . To determine the particular different trajectory, a certain fine-tuning of initial conditions was employed for graphical reasons. The thick curve depends on , and hence even though it is defined by the adiabatic Hamiltonian , it really depends on the full initial conditions of the six canonical co-ordinates in the exact . We were able to generate a second exact trajectory with (almost) exactly the same as the trajectory from Fig. 1, so that it could be plotted in the same Fig. 4, by imposing initial conditions at time . The conditions we imposed for the new trajectory at this time were that all six phase-space variables should equal those of the Fig. 1 trajectory at the same time , except that we set . This displacement of , while keeping all else fixed, produced bound motion, as in the Fig. 1 trajectory, but with higher amplitude oscillation in the local well of ; hence higher , and so earlier stalling time .
The dashed trajectory of Fig. 4 has only slightly higher than the solid trajectory; but this small difference eventually makes a large difference. During the driving phase of motion, the dashed trajectory of as shown in Fig. A3a) does not visibly differ from the original one, because the difference is only in oscillations to small to be seen on the plotted scale. The slightly higher in the dashed case makes a substantial difference in the amount of work the daemon does, however, because the higher of the dashed trajectory means higher and earlier , so that steady downconversion stops sooner in the dashed trajectory, as we see in both parts of Fig. A3, as well as in the main text’s Fig. 4. In the dashed case the daemon does nearly 39% less total work on the slow mass than in the original trajectory of Fig. 1. The general limitation on daemon efficiency from the adiabatic invariance of is not crippling, but neither is it trivial.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) M. Born and V. Fock, Beweis des Adiabatensatzes Z. Phys. A 51 , 165–80 (1928)
- 2(2) M. Born and R. Oppenheimer, Zur Quantentheorie der Molekeln Ann. Phys. 389 457–84 (1927)
- 3(3) S. Weinberg, The Quantum Theory of Fields: Volume 2, Modern Applications , Cambridge University Press (2005)
- 4(4) R. Shankar, Renormalization-group approach to interacting fermions Rev. Mod. Phys. 66 , 129 (1994)
- 5(5) J. Berges, N. Tetradis, and C. Wetterich, Non-perturbative renormalization flow in quantum field theory and statistical physics Phys. Rep. 363 , 223–386 (2002)
- 6(6) V.I. Arnold, Mathematical methods of classical mechanics , Springer (1989)
- 7(7) Boris V. Chirikov, A universal instability of many-dimensional oscillator systems. Phys. Rep. 52 , 263 (1979)
- 8(8) At least 25 digits of numerical working precision are required to reproduce the plotted evolution of Fig. 1 from the stated initial conditions. The highly nonlinear dynamics involves non-adiabatic crossing of a separatrix, and the precise evolution is therefore quite sensitive. Numerically experimenting with different conditions readily confirms, however, that fine-tuned initial conditions are not required in order to obtain qualitatively similar driving behavior. High precision is merel
