Having covered the basics of continuous-time processes and filtrations in the previous posts, I now move on to stochastic integration. In standard calculus and ordinary differential equations, a central object of study is the derivative of a function . This does, however, require restricting attention to differentiable functions. By integrating, it is possible to generalize to bounded variation functions. If is such a function and is continuous, then the Riemann-Stieltjes integral is well defined. The Lebesgue-Stieltjes integral further generalizes this to measurable integrands.

However, the kinds of processes studied in stochastic calculus are much less well behaved. For example, with probability one, the sample paths of standard Brownian motion are nowhere differentiable. Furthermore, they have infinite variation over bounded time intervals. Consequently, if is such a process, then the integral is not defined using standard methods.

Stochastic integration with respect to standard Brownian motion was developed by Kiyoshi Ito. This required restricting the class of possible integrands to be adapted processes, and the integral can then be constructed using the Ito isometry. This method was later extended to more general square integrable martingales and, then, to the class of semimartingales. It can then be shown that, as with Lebesgue integration, a version of the bounded and dominated convergence theorems are satisfied.

In these notes, a more direct approach is taken. The idea is that we simply define the stochastic integral such that the required elementary properties are satisfied. That is, it should agree with the explicit expressions for certain simple integrands, and should satisfy the bounded and dominated convergence theorems. Much of the theory of stochastic calculus follows directly from these properties, and detailed constructions of the integral are not required for many practical applications. Before moving on to the definition, note that, whereas the value of a standard Lebesgue integral is just a real number, stochastic integrals take values in the space of random variables. It is therefore possible to weaken some of the properties required of such integrals. First, any identity is only required to be satisfied almost surely. That is, on a set of probability one. Second, the notion of convergence of a sequence of real numbers can be replaced by the much weaker idea of convergence in probability.

We work with respect to a complete filtered probability space . Then, the space of random variables is denoted by , or simply . This is the space of measurable functions or, more precisely, the equivalence classes of such functions up to equality on a set of probability one.

Recall that an elementary predictable process is of the form

for , times , -measurable random variable and -measurable random variables . The stochastic integral of this with respect to a process is

(1) |

Integration is a linear function of the integrand, so that

(2) |

for real numbers and predictable processes .

Also, the stochastic integral should satisfy *bounded convergence in probability*. That is, if is a sequence of predictable processes converging to a limit , and is uniformly bounded for some constant , then the integrals converge,

(3) |

These properties are enough to define stochastic integration for bounded and predictable integrands. The notation is used to denote the bounded predictable processes.

Definition 1Letbe a process. The stochastic integral up to timewith respect to, if it exists, is a map

which

Proving the existence of the stochastic integral for an arbitrary integrator is, in general, quite a difficult problem. However, uniqueness is a simple consequence of the monotone class theorem. Also, note that the requirement that the integral is a linear function of the integrand was not mentioned in the definition above. However, this property is again a simple consequence of the monotone class theorem.

Lemma 2Letbe a stochastic process. If the stochastic integral up to timeas given by Definition 1 exists, then it is uniquely defined. Furthermore, linearity in the integrand (2) is satisfied.

*Proof:* Suppose that there were two versions of the integral, both satisfying the required properties. Denoting them by and respectively, let be the set of all bounded predictable processes satisfying . From the definition above, this includes all bounded elementary integrands and is closed under bounded convergence. However, the elementary predictable processes generate the predictable sigma-algebra. So, by the monotone class theorem, contains all bounded predictable processes, and .

Linearity follows in a similar way. For elementary integrands, it follows from equation (3). More generally, fix real and bounded elementary . Then, let consist of the set of bounded predictable processes such that (2) is satisfied. Again, this includes the elementary processes and is closed under bounded convergence. So, (2) is satisfied for all elementary and bounded predictable .

Finally, fix a bounded predictable process and let be the set of all bounded predictable processes such that (2) is satisfied. As proven above, this contains all elementary processes. Also, it is closed under bounded convergence, so (2) is satisfied for all . ⬜

Any process with respect to which the stochastic integral is well defined must necessarily satisfy certain basic properties.

Lemma 3Letbe an adapted stochastic process such that, for each, the stochastic integralgiven by Definition 1 exists. Then,

is right-continuous in probability.The set

(4)

is bounded in probability, for each.has a cadlag verson.

*Proof:* If is a sequence of times, then bounded convergence gives

in probability as . So, is right-continuous in probability.

Next, we can show that the set of integrals for *predictable* integrands is bounded in probability, for each fixed time . In particular, by restricting to elementary integrands, this will imply that (4) is bounded in probability.

Arguing by contradiction, suppose that this is not the case. By definition, this means that there is an and a sequence of predictable processes such that for all *n*. However, this contradicts bounded convergence in probability,

as . Hence, the set given by (4) must indeed be bounded in probability.

Finally, using a result from an earlier post, the existence of cadlag versions follows from the first two properties and the condition that the process is adapted. ⬜

The first two conditions above are not only necessary for the existence of the stochastic integral, they are also sufficient. That fact is not needed here though, and the existence of the integral given these conditions will be shown in a later post. Adapted processes with respect to which stochastic integration is well defined are known as *semimartingales*. By the result above, there is no loss of generality in only considering cadlag processes.

Definition 4A semimartingaleis a cadlag adapted process such that, for each, the stochastic integral given by Definition 1 exists.

Simple examples of semimartingales include the cadlag adapted processes of finite variation over all bounded time intervals. Then, the stochastic integral of Definition 1 coincides with the Lebesgue-Stieltjes integral. More interesting examples include Brownian motion and, as we shall see later, all local martingales.

As mentioned above, the stochastic integral was originally constructed with respect to Brownian motion and, then, similar techniques were applied to arbitrary martingales. This led, historically, to the definition of a semimartingale as a process which can be decomposed into a sum of a finite variation process and a local martingale. That such processes are in fact equivalent to the definition above is a consequence of the Bichteler-Dellacherie theorem which will be covered later in these notes.

In Chapter 2, Protter defines a process to be a

total semimartingaleif is càdlàg, adapted, and is continuous where is the collection of simple predictable processes topologized by uniform convergence in and is the space of finite-valued random variables topologized by convergence in probability.He further defines a

semimartingaleto be a total semimartingale stopped at a fixed time denoted .Theorem 8, Chapter 2 states:

Each martingale with càdlàg paths is a semimartingale.

Corollary 1 to this theorem states:

Each càdlàg, locally square integrable local martingale is a semimartingale.

Corollary 2 to this theorem states:

A local martingale with with continuous paths is a semimartingale.

And as proof states:

Apply Corollary 1 together with Theorem 51 in Chapter 1.

Now Theorem 51 states:

Let be a local martingale such that for every . Then is a martingale. If , then X is a uniformly integrable martingale.

In order to apply Corollary 1 we need to show that the local martingale we are given is locally square integrable. But how does Theorem 51 help with this? The premise for second part of Theorem 51 does not even hold, for example, take to be Brownian Motion.

Hi.

[Aside: Protter’s definition of a semimartingale is (seemingly) weaker than the one I gave in this post, as I required the existence of a stochastic integral as part of the definition. The equivalence between the two definitions is proven in the post Existence of the Stochastic Integral and restated as part of the Bichteler-Dellacherie Theorem.]

On to your question. You just want to show that the continuous local martingale

Xis locally a square integrable martingale. This uses continuity. Let be the first timetat which |X| ≥_{t}n. Continuity tells you that is bounded bynand Theorem 51 tells that it is a martingale. Actually, Theorem 51 is not really needed because once you know that arelocallysquare integrable martingales, the same is true ofX. Theorem 51 does shorten the argument slightly though. Hope that helps.That does thanks very much. Good notes by the way.

Can I have all these notions in the same file because it is very interest for me.

[

George: I edited your email address out. Are you sure you wanted it here for everyone to see? I can add it back if you want.]Hi.

I’m glad you find these interesting. I will join them together into a single file at some point, and post them on this site. Probably after I have completed the next few posts so that the ‘general theory of semimartingales’ section is complete.

I can’t just join them together immediately, as it will need some work to link them together making sure that subheadings, links, etc are working properly. So, like I say, it will probably be after I have completed the current section.

Dear George,

I keep noticing in the literature on stochastic processes that the assumption about completeness of the probability space is made at the very beginning. But the authors don’t point out where the assumption is actually used. I was very glad to see that you made the same assumption and I can ask you about it. Why is it important and in what cases it is not required?

Thank you.

Alex.

There’s a few places where completeness of the filtration is used. It is not really necessary, but it helps simplify things.

i) To ensure that processes have adapted cadlag modifications. In particular – martingales, sub(super)martingales, Feller processes, processes for which the stochastic integral is well defined (see Lemma 3 above). You don’t really need completeness for this, just requiring to contain all zero probability sets in is enough. This did come up in an earlier comment to the post on cadlag modifications.

ii) To ensure that hitting times are stopping times (debut theorem). Completeness is not really needed because usually it is enough to find a stopping time which is almost surely equal to the hitting time (again, this has come up in a previous comment).

iii) To ensure that stochastic integrals have a cadlag modification. Even if X is a semimartingale and, hence, is cadlag by definition, it does not follow that stochastic integrals have adapted cadlag modifications. Using dominated convergence, you can show that it has a modification which is almost surely cadlag. This is probably all that you need, although it helps to as least assume that contains the zero probability sets of , so that you can use cadlag adapted versions of the integral.

Dear George,

I have a question on that completeness issue. You say that instead of completeness of filtrations we can add zero probability sets from F_oo to F_t. Does F_oo have to be complete?

Thank you.

Alex.

If you want the debut theorem to hold then, yes, you do need to be complete or – at least –

universally complete. For most other results, you do not need to be complete.But the completeness seems to be a requirement as pointed out by some authors. For example, in Krylov “Introduction to the theory of diffusion procesess”, p.94. In the remark he says that the completeness of the filtration is requred for the stochastic integral (wrt a Brownian motion) to be adapted. The reason is the following.

We want the integral wrt a BM to be continuous and adapted. When defining the stochastic integral, it is possible to find simple processes such that their integrals are continuous and converge uniformly with probability 1, and thus, the continuity is preserved almost surely. Since the convergence is only in almost sure sense, the limit does not have to be adapted unless the filtration is complete.

SImilar construction in Liptser, Shiryaev “Statistics of random processes”, V.2, p.102 also requires the filtration to be augmented by all zero sets from the original sigma-algebra which is assumed to be complete.

Could you please explain these deferences in construction of stochastic integrals (for example, wrt Brownian motion)? For what cases we have to require the filtration (and or the original probability space) to be complete?

Note quite. If a sequence of (simple) integrals converges uniformly with probability 1, to a limit , then there exists a set with probability 1 such that convergence is uniform on A. We know that A can be taken to be in because each of the simple integrals is -measurable. Then, you can take which converges uniformly and, hence, is continuous. So, we need to know that A is in for all t, which is guaranteed by the requirement that all zero probability sets in are in . Completeness is a stronger condition than is necessary.

Dear Goerge, thank you very much for spending your time on this discussion. However, you say

“Then, you can take which converges uniformly and, hence, is continuous.”

Here, you define the integral to be 0, outside the set A which actually yields \omega-wise continuity (not P-a.s. continuity). This way of defining the integral is fine. However, if we do not make this assumption and the only thing that we know is that it is possible to find a sequence of simple processes (continuous and adapted) that converge uniformly P-a.s. is it still enough to add all zero sets from F_oo (not complete) to F_t to claim that the limit process is adapted?

I’m not exactly sure what you are asking now. So long as you add all zero sets from to then it is possible to construct a stochastic integral which is both adapted and satisfies all the usual pathwise properties (cadlag, etc). If, on the other hand, you have already constructed the integral in such a way that the usual properties are satisfied (which are only specified in an almost sure sense) then, no, you can’t guarantee that it is adapted unless you complete the filtration. In fact, just looking at real valued random variables (so, no processes and no integration), if a sequence of random variables X

_{n}almost-surely converges to a limitXthen it is only guaranteed that X is measurable on the set where this convergence holds. So, you can only conclude that X is measurable if the probability space is complete.Yes, now I see that this requirement depends on the way the stochastic integral is constructed. In the two mentioned books this assumption is used. However, it seems like the integral can be constructed without this assumption. Thank you very much again for explaining this issue.

I have a problem with the proof of linearity in the integrand in Lemma 2. You check that

Vcontains the elementary processes and is closed under bounded convergence. But the monoton class theorem requiresVto be a vector space too. Is it necessary to include linearity in Definition 1?Hi. No, it is not necessary to include linearity. Obviously, we do want linearity and it might be worthwhile including it in the definition to emphasize this fact, but it is not necessary.

Also, I don’t think it is quite true that the monotone class theorem requires V to be a vector space. Most statements do require this, but there are several slightly different ways of stating the monotone class theorem, which start from different premises. I have been intending to include a post on the monotone class theorem for some time, as I don’t know any really good online resource for it to link to.

You should be able to prove the following though. Let (X,𝒜) be a measurable space, V, W sets of bounded functions f:X->R such that.

(i) W is contained in V.

(ii) W is closed under taking linear combinations.

(iii) There exists a pi-system 𝒮 generating the sigma algebra 𝒜 such that the indicator function 1

_{S}is in W for all S ∈ 𝒮(iv) V is closed under taking limits of uniformly bounded sequences.

Then, V contains all the 𝒜 measurable and bounded functions from X to R.

Consider letting V

_{1}be the set of all functions f in V such that af+g is in V for all real a and g in W.Let V

_{2}be the set of all functions f in V_{1}such that af+g is in V_{1}for all real a and g in V_{1}.Show that V

_{2}satisfies the properties above ascribed to V, and is also closed under taking linear combinations. You can now apply the monotone class theorem to V_{2}to conclude that it (and hence, also V) contains all bounded and measurable functions f:X->R.In the context of Lemma 2, W would be the space of bounded elementary integrands and V would be the set of bounded predictable processes for which the integral is uniquely defined.

Dear George,

thanks for your quick reply. This completely solves my problem with the proof of linearity in Lemma 2.

Hi George,

The idea to write a post about Monotone Class Theorem … and all its functional cousins is a very good idea. Personally, I find painfull textbook’s that only give as a proof for a theorem a sentence such as “by a Monotone Class Argument… the result follows they should at least define the collection of sets (or functions), that are the -systems and or -systems (or functional equivalents) to plug in the MCT. Anyway a “userguide for MCT” would be a valuable item of your blog.

Best regards.

toultoultim: I’ll work on this – probably won’t be the very next entry, more likely in a few posts time.

May be a bit late for toultoutim, but here is the post https://almostsure.wordpress.com/2019/10/27/the-functional-monotone-class-theorem

Dear George,

Thanks a lot for your great blog. I learn a lot from it.

Here is my question. Sorry if it is stupid. You write above:

“Also, the stochastic integral should satisfy bounded convergence in probability. That is, if is a sequence of predictable processes converging to a limit …”

You have probably explained somewhere in what sense the sequence of predictable processes does converge, but I am unable to find where. Or is it obvious ? Is it UCP convergence or almost sure uniform convergence on compact sets ?

Thanks and regards

Dear George,

Thank you for your notes. However, I have a question. Let be a continuous martingale. What should be the requirements for the process b in the stochastic integral

For some reason in Liptser, Shiryaev (2001) on page 200, the requirement is b^2 >= c > 0. Is it really necessary for the integrand to be bounded?

Thank you.

Best,

Alex.

You just need to be X-integrable. For a continuous martingale, this is equivalent to to be almost-surely finite at each positive time t. Clearly, 1/b being bounded is sufficient, but is not necessary. See my post on continuous local martingales at https://almostsure.wordpress.com/2010/04/01/continuous-local-martingales.

great

Dear George,

thanks for your notes. They have helped me a lot to understand some abstract parts of Protter’s book.

Your link to the monotone class theorem is broken. The correct URL is .

Ok, I formatted my previous comment wrong. This is the URL: https://planetmath.org/functionalmonotoneclasstheorem

Thanks, I fixed it.

In your condition (3), which mode of convergence of to are you using? I guess it is a.s. convergence. In the proof of Lemma 3, the integrand does not converge uniformly to 0 nor in ucp.

It is pointwise convergence. for each and . Or, you can use almost all , it makes no difference.

“Simple examples of semimartingales include the cadlag adapted processes which of finite variation over all bounded time intervals.”

“which” seems to be extraneous…

[GL: Fixed, thanks!]I have questions about: [Between Eq. (2) and (3)], you have stated that, “…if {\xi^n} is a sequence of predictable processes converging to a limit {\xi}…”….(0) What would be a/the metric? (1) converge in which sense? (2) Do all x_i’s have to have jumps at the same times? (3) I may have misunderstood…the jump-times ti_i are deterministic; what would happen if they were stopping times…now, I have the same doubt as in (2)…would the “composition of random functions” type argument work or there is more to it?