<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
	>

<channel>
	<title>in   theory</title>
	<atom:link href="http://lucatrevisan.wordpress.com/feed/" rel="self" type="application/rss+xml" />
	<link>http://lucatrevisan.wordpress.com</link>
	<description>&#34;Marge, I agree with you - in theory. In theory, communism works. In theory.&#34; -- Homer Simpson</description>
	<lastBuildDate>Sun, 19 May 2013 17:08:40 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
<cloud domain='lucatrevisan.wordpress.com' port='80' path='/?rsscloud=notify' registerProcedure='' protocol='http-post' />
<image>
		<url>http://s2.wp.com/i/buttonw-com.png</url>
		<title>in   theory</title>
		<link>http://lucatrevisan.wordpress.com</link>
	</image>
	<atom:link rel="search" type="application/opensearchdescription+xml" href="http://lucatrevisan.wordpress.com/osd.xml" title="in   theory" />
	<atom:link rel='hub' href='http://lucatrevisan.wordpress.com/?pushpress=hub'/>
		<item>
		<title>The Power Method</title>
		<link>http://lucatrevisan.wordpress.com/2013/05/08/the-power-method/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/05/08/the-power-method/#comments</comments>
		<pubDate>Wed, 08 May 2013 20:57:26 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[Expanders]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[theory]]></category>
		<category><![CDATA[eigenvalues]]></category>
		<category><![CDATA[eigenvectors]]></category>
		<category><![CDATA[Laplacian]]></category>
		<category><![CDATA[Nisheeth Vishnoi]]></category>
		<category><![CDATA[power method]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2688</guid>
		<description><![CDATA[This week, the topic of my online course on graph partitioning and expanders is the computation of approximate eigenvalues and eigenvectors with the power method. If is a positive semidefinite matrix (a symmetric matrix all whose eigenvalues are nonnegative), then the power method is simply to pick a random vector , and compute . If [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2688&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>This week, the topic of my <a href="https://venture-lab.stanford.edu/expanders/" />online course on graph partitioning and expanders</a> is the computation of approximate eigenvalues and eigenvectors with the power method.</p>
<p>If <img src='http://s0.wp.com/latex.php?latex=M&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='M' title='M' class='latex' /> is a positive semidefinite matrix (a symmetric matrix all whose eigenvalues are nonnegative), then the power method is simply to pick a random vector <img src='http://s0.wp.com/latex.php?latex=x%5Cin+%5C%7B+-1%2C%2B1+%5C%7D%5En&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x&#92;in &#92;{ -1,+1 &#92;}^n' title='x&#92;in &#92;{ -1,+1 &#92;}^n' class='latex' />, and compute <img src='http://s0.wp.com/latex.php?latex=y%3A%3D+M%5Ek+x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='y:= M^k x' title='y:= M^k x' class='latex' />. If <img src='http://s0.wp.com/latex.php?latex=k&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='k' title='k' class='latex' /> is of the order of <img src='http://s0.wp.com/latex.php?latex=%5Cfrac+1+%5Cepsilon+%5Clog+%5Cfrac+n+%5Cepsilon&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;frac 1 &#92;epsilon &#92;log &#92;frac n &#92;epsilon' title='&#92;frac 1 &#92;epsilon &#92;log &#92;frac n &#92;epsilon' class='latex' />, then one has a constant probability that</p>
<p><img src='http://s0.wp.com/latex.php?latex=%5Cfrac+%7By%5ET+M+y%7D%7By%5ET+y%7D+%5Cgeq+%281-%5Cepsilon%29+%5Cmax_%7Bx%7D+%5Cfrac+%7Bx%5ET+M+x%7D%7Bx%5ET+x%7D+%3D+%281-%5Cepsilon%29+%5Clambda_1&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;frac {y^T M y}{y^T y} &#92;geq (1-&#92;epsilon) &#92;max_{x} &#92;frac {x^T M x}{x^T x} = (1-&#92;epsilon) &#92;lambda_1' title='&#92;frac {y^T M y}{y^T y} &#92;geq (1-&#92;epsilon) &#92;max_{x} &#92;frac {x^T M x}{x^T x} = (1-&#92;epsilon) &#92;lambda_1' class='latex' /></p>
<p>where <img src='http://s0.wp.com/latex.php?latex=%5Clambda_1&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;lambda_1' title='&#92;lambda_1' class='latex' /> is the largest eigenvalue of <img src='http://s0.wp.com/latex.php?latex=M&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='M' title='M' class='latex' />. If we are interested in the Laplacian matrix <img src='http://s0.wp.com/latex.php?latex=L+%3D+I+-+%5Cfrac+1d+A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L = I - &#92;frac 1d A' title='L = I - &#92;frac 1d A' class='latex' /> of a <img src='http://s0.wp.com/latex.php?latex=d&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='d' title='d' class='latex' />-regular graph, where <img src='http://s0.wp.com/latex.php?latex=A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='A' title='A' class='latex' /> is the adjacency matrix of the graph, this gives a way to compute an approximation of the largest eigenvalue, and a vector of approximately maximum Rayleigh quotient, which is useful to approximate Max Cut, but not to apply spectral partitioning algorithms. For those, we need a vector that approximates the eigenvector of the second smallest eigenvalue.</p>
<p>Equivalently, we want to approximate the second largest eigenvalue of the adjacency matrix <img src='http://s0.wp.com/latex.php?latex=A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='A' title='A' class='latex' />. The power method is easy to adjust to compute the second largest eigenvalue instead of the largest (if we know an eigenvector of the largest eigenvalue): after you pick the random vector, subtract the component of the vector that is parallel to the eigenvector of the largest eigenvalue. In the case of the adjacency matrix of a regular graph, subtract from every coordinate of the random vector the average of the coordinates.</p>
<p>The adjacency matrix is not positive semidefinite, but we can adjust it to be by adding a multiple of the identity matrix. For example we can work with <img src='http://s0.wp.com/latex.php?latex=%5Cfrac+12+I+%2B+%5Cfrac+1%7B2d%7D+A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;frac 12 I + &#92;frac 1{2d} A' title='&#92;frac 12 I + &#92;frac 1{2d} A' class='latex' />. Then the power method reduces to the following procedure: pick randomly <img src='http://s0.wp.com/latex.php?latex=x+%5Csim+%5C%7B+-1%2C1%5C%7D&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x &#92;sim &#92;{ -1,1&#92;}' title='x &#92;sim &#92;{ -1,1&#92;}' class='latex' />, then subtract <img src='http://s0.wp.com/latex.php?latex=%5Csum_i+x_i%2Fn&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;sum_i x_i/n' title='&#92;sum_i x_i/n' class='latex' /> from every entry of <img src='http://s0.wp.com/latex.php?latex=x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x' title='x' class='latex' />, then repeat the following process <img src='http://s0.wp.com/latex.php?latex=k+%3D+O%5Cleft%28+%5Cfrac+1+%5Cepsilon+%5Clog+%5Cfrac+n+%5Cepsilon+%5Cright%29&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='k = O&#92;left( &#92;frac 1 &#92;epsilon &#92;log &#92;frac n &#92;epsilon &#92;right)' title='k = O&#92;left( &#92;frac 1 &#92;epsilon &#92;log &#92;frac n &#92;epsilon &#92;right)' class='latex' /> times: for every entry <img src='http://s0.wp.com/latex.php?latex=i&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='i' title='i' class='latex' />, assign <img src='http://s0.wp.com/latex.php?latex=x_i+%3A%3D+%5Cfrac+12+x_i+%2B+%5Cfrac+1+%7B2d%7D+%5Csum_%7Bj%3A+%28i%2Cj%29+%5Cin+E%7D+x_j&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x_i := &#92;frac 12 x_i + &#92;frac 1 {2d} &#92;sum_{j: (i,j) &#92;in E} x_j' title='x_i := &#92;frac 12 x_i + &#92;frac 1 {2d} &#92;sum_{j: (i,j) &#92;in E} x_j' class='latex' />, that is, replace the value that the vector assigns to vertex <img src='http://s0.wp.com/latex.php?latex=i&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='i' title='i' class='latex' /> with a convex combination of the current value and the current value of the neighbors. (Note that one iteration can be executed in time <img src='http://s0.wp.com/latex.php?latex=O%28%7CV%7C%2B%7CE%7C%29&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='O(|V|+|E|)' title='O(|V|+|E|)' class='latex' />.</p>
<p>The problem is that if we started from a graph whose Laplacian matrix has a second smallest eigenvalue <img src='http://s0.wp.com/latex.php?latex=%5Clambda_2&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;lambda_2' title='&#92;lambda_2' class='latex' />, the matrix <img src='http://s0.wp.com/latex.php?latex=%5Cfrac+12+I+%2B+%5Cfrac+1%7B2d%7D+A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;frac 12 I + &#92;frac 1{2d} A' title='&#92;frac 12 I + &#92;frac 1{2d} A' class='latex' /> has second largest eigenvalue <img src='http://s0.wp.com/latex.php?latex=1-+%5Cfrac+%7B%5Clambda_2%7D2&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='1- &#92;frac {&#92;lambda_2}2' title='1- &#92;frac {&#92;lambda_2}2' class='latex' />, and if the power method finds a vector of Rayleigh quotient at least <img src='http://s0.wp.com/latex.php?latex=%281-%5Cepsilon%29+%5Ccdot+%5Cleft%28+1-+%5Cfrac+%7B%5Clambda_2%7D2+%5Cright%29&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='(1-&#92;epsilon) &#92;cdot &#92;left( 1- &#92;frac {&#92;lambda_2}2 &#92;right)' title='(1-&#92;epsilon) &#92;cdot &#92;left( 1- &#92;frac {&#92;lambda_2}2 &#92;right)' class='latex' /> for <img src='http://s0.wp.com/latex.php?latex=%5Cfrac+12+I+%2B+%5Cfrac+1%7B2d%7D+A&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;frac 12 I + &#92;frac 1{2d} A' title='&#92;frac 12 I + &#92;frac 1{2d} A' class='latex' />, then that vector has Rayleigh quotient about <img src='http://s0.wp.com/latex.php?latex=%5Clambda_2+-+2%5Cepsilon&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;lambda_2 - 2&#92;epsilon' title='&#92;lambda_2 - 2&#92;epsilon' class='latex' /> for <img src='http://s0.wp.com/latex.php?latex=L&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L' title='L' class='latex' />, and unless we choose <img src='http://s0.wp.com/latex.php?latex=%5Cepsilon&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;epsilon' title='&#92;epsilon' class='latex' /> of the same order as <img src='http://s0.wp.com/latex.php?latex=%5Clambda_2&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;lambda_2' title='&#92;lambda_2' class='latex' /> we get nothing. This means that the number of iterations has to be about <img src='http://s0.wp.com/latex.php?latex=1%2F%5Clambda_2&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='1/&#92;lambda_2' title='1/&#92;lambda_2' class='latex' />, which can be quite large.</p>
<p>The video below (taken from this week&#8217;s lecture) shows how slowly the power method progresses on a small cycle with 31 vertices. It goes faster on the hypercube, which has a much larger <img src='http://s0.wp.com/latex.php?latex=%5Clambda_2&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='&#92;lambda_2' title='&#92;lambda_2' class='latex' />.</p>
<span class='embed-youtube' style='text-align:center; display: block;'><iframe class='youtube-player' type='text/html' width='490' height='306' src='http://www.youtube.com/embed/cbYcn8o0Jfg?version=3&#038;rel=1&#038;fs=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;wmode=transparent' frameborder='0'></iframe></span>
<p>A better way to apply the power method to find small eigenvalues of the Laplacian is to apply the power method to the pseudoinverse <img src='http://s0.wp.com/latex.php?latex=L%5E%2B&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L^+' title='L^+' class='latex' /> of the Laplacian. If the Laplacian of a connected graph has eigenvalues <img src='http://s0.wp.com/latex.php?latex=0+%3D+%5Clambda_1+%3C+%5Clambda_2+%5Cleq+%5Ccdots+%5Cleq+%5Clambda_n&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='0 = &#92;lambda_1 &lt; &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_n' title='0 = &#92;lambda_1 &lt; &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_n' class='latex' />, then the pseudoinverse <img src='http://s0.wp.com/latex.php?latex=L%5E%2B&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L^+' title='L^+' class='latex' /> has eigenvalues <img src='http://s0.wp.com/latex.php?latex=0%2C+%5Cfrac+1+%7B%5Clambda_2%7D%2C+%5Ccdots%2C+%5Cfrac+1+%7B%5Clambda_n%7D&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='0, &#92;frac 1 {&#92;lambda_2}, &#92;cdots, &#92;frac 1 {&#92;lambda_n}' title='0, &#92;frac 1 {&#92;lambda_2}, &#92;cdots, &#92;frac 1 {&#92;lambda_n}' class='latex' /> with the same eigenvectors, so approximately finding the largest eigenvalue of <img src='http://s0.wp.com/latex.php?latex=L%5E%2B&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L^+' title='L^+' class='latex' /> is the same problem as approximately finding the second smallest eigenvalue of <img src='http://s0.wp.com/latex.php?latex=L&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L' title='L' class='latex' />.</p>
<p>Although we do not have fast algorithms to compute <img src='http://s0.wp.com/latex.php?latex=L%5E%2B&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L^+' title='L^+' class='latex' />, what we need to run the power method is, for a given <img src='http://s0.wp.com/latex.php?latex=x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x' title='x' class='latex' />, to find the <img src='http://s0.wp.com/latex.php?latex=y&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='y' title='y' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=L+y+%3D+x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L y = x' title='L y = x' class='latex' />, that is, to solve the linear system <img src='http://s0.wp.com/latex.php?latex=Ly+%3D+x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='Ly = x' title='Ly = x' class='latex' /> in <img src='http://s0.wp.com/latex.php?latex=y&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='y' title='y' class='latex' /> given <img src='http://s0.wp.com/latex.php?latex=L&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L' title='L' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=x&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='x' title='x' class='latex' />.</p>
<p>For this problem, Spielman and Teng gave an algorithm nearly linear in the number of nonzero of <img src='http://s0.wp.com/latex.php?latex=L&amp;bg=ffffff&amp;fg=545454&amp;s=0' alt='L' title='L' class='latex' />, and new algorithms have been developed more recently (and with some promise of being practical) by Koutis, Miller and Peng and by Kelner, Orecchia, Sidford and Zhu.</p>
<p>Coincidentally, just this week, Nisheeth Vishnoi has completed his monograph <a href="http://research.microsoft.com/en-us/um/people/nvishno/Site/Lxb-Web.pdf">Lx=b</a> on algorithms to solve such linear systems and their applications. It&#8217;s going to be great summer reading for those long days at the beach.</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2688/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2688/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2688&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/05/08/the-power-method/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>I totally fell for it</title>
		<link>http://lucatrevisan.wordpress.com/2013/05/05/i-totally-fell-for-it/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/05/05/i-totally-fell-for-it/#comments</comments>
		<pubDate>Sun, 05 May 2013 22:03:29 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[diversions]]></category>
		<category><![CDATA[false alarm]]></category>
		<category><![CDATA[fortune cookie]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2680</guid>
		<description><![CDATA[The last time I ate at a place that gives fortune cookies, I got this:   The second-to-last time I had dinner in a place that gives fortune cookies, however, I had got this:   Oh well&#8230;<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2680&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>The last time I ate at a place that gives fortune cookies, I got this:</p>
<p><a href="http://lucatrevisan.files.wordpress.com/2013/05/img_1640.jpg"><img class="size-full wp-image" id="i-2683" alt="Image" src="http://lucatrevisan.files.wordpress.com/2013/05/img_1640.jpg?w=487" /></a></p>
<p> </p>
<p>The second-to-last time I had dinner in a place that gives fortune cookies, however, I had got this:</p>
<p><span id="more-2680"></span></p>
<p><a href="http://lucatrevisan.files.wordpress.com/2013/05/img_1617.jpg"><img class="size-full wp-image" id="i-2686" alt="Image" src="http://lucatrevisan.files.wordpress.com/2013/05/img_1617.jpg?w=487" /></a></p>
<p> </p>
<p>Oh well&#8230;</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2680/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2680/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2680&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/05/05/i-totally-fell-for-it/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>

		<media:content url="http://lucatrevisan.files.wordpress.com/2013/05/img_1640.jpg?w=487" medium="image">
			<media:title type="html">Image</media:title>
		</media:content>

		<media:content url="http://lucatrevisan.files.wordpress.com/2013/05/img_1617.jpg?w=487" medium="image">
			<media:title type="html">Image</media:title>
		</media:content>
	</item>
		<item>
		<title>Ora e sempre resistenza</title>
		<link>http://lucatrevisan.wordpress.com/2013/04/25/ora-e-sempre-resistenza/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/04/25/ora-e-sempre-resistenza/#comments</comments>
		<pubDate>Thu, 25 Apr 2013 09:00:29 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[history]]></category>
		<category><![CDATA[Italy]]></category>
		<category><![CDATA[25 Aprile]]></category>
		<category><![CDATA[resistenza]]></category>
		<category><![CDATA[things that are excellent]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2674</guid>
		<description><![CDATA[Today it&#8217;s my favorite of Italy&#8217;s public holidays. To keep a long story long, at the start of WW2, Italy, which was an ally of Germany, was initially neutral, in part because its armed forces were completely unprepared for war. At some point in the May of 1940, with German troops advancing into France, and [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2674&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Today it&#8217;s my favorite of Italy&#8217;s public holidays. </p>
<p>To keep a long story long, at the start of WW2, Italy, which was an ally of Germany, was initially neutral, in part because its armed forces were completely unprepared for war. At some point in the May of 1940, with German troops advancing into France, and British troops evacuating the continent, Italy decided to join what looked like a soon-to-end war, in order to claim some French territories and colonies. </p>
<p>But then, in 1941, Germany attacked Russia and Japan attacked the US, underestimating what they were getting into, and by the beginning of 1943 the tide was clearly turning against the &#8220;axis.&#8221; Italy&#8217;s king, who was definitely not the &#8220;fight until the last man&#8221; type, had Mussolini arrested, installed a general as prime minister, and started negotiating Italy&#8217;s surrender with the allies (even as Italian troops were fighting with the Germans in Russia and in Africa). Eventually, on September 8, 1943, the king announced a cease-fire. Because of the secrecy of the negotiations, nobody knew what was going in advance, and most of the Italian troops that were fighting with the Germans were taken prisoners, while the rest of the armed forces basically disbanded. German troops came into Italy from the North to occupy it, even as allied troops landed in Sicily and took control of most of Southern Italy. The king fled to the South, and the Germans freed Mussolini and installed him as head of a puppet government in the North.</p>
<p>With the Italian army disbanded, and with the allies neglecting the &#8220;Southern front&#8221; in Italy as they were plotting the landing in Normandy, guerilla groups were formed in Northern Italy to fight the Germans. Eventually, in April 1945 the German troops were retreating from the Eastern and Western fronts against the advancing American and Russian forces, and the allied made another push in Italy; concurrently, the resistance organizations planned an insurrection that, on April 25, liberated Torino and Milan. All the German forces in Italy surrendered on April 29.</p>
<p>The resistance was the training ground of some of the first generation of politicians of the new Italian Republic (a referendum to abolish the monarchy passed in 1946, and a new Republican constitution was approved in 1948), and it brought people who were willing to die for their ideals into politics. That spirit didn&#8217;t last very long, but it remains one of the few bright spots in recent Italian history.</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2674/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2674/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2674&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/04/25/ora-e-sempre-resistenza/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>Fun with expanders starts today</title>
		<link>http://lucatrevisan.wordpress.com/2013/04/23/fun-with-expanders-starts-today/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/04/23/fun-with-expanders-starts-today/#comments</comments>
		<pubDate>Wed, 24 Apr 2013 01:21:44 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[Expanders]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[Expanders Online]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2672</guid>
		<description><![CDATA[Long in the making, the online course on expanders starts today. In the first week of class: what are the topics of the course, and how to prove that the eigenvalues of the adjacency matrix of a regular graph tell you how many connected components there are in the graph.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2672&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Long in the making, the online course on expanders <a href="https://venture-lab.stanford.edu/expanders">starts today</a>.</p>
<p>In the first week of class: what are the topics of the course, and how to prove that the eigenvalues of the adjacency matrix of a regular graph tell you how many connected components there are in the graph. </p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2672/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2672/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2672&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/04/23/fun-with-expanders-starts-today/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>Introducing eXpandr</title>
		<link>http://lucatrevisan.wordpress.com/2013/04/01/introducing-expandr/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/04/01/introducing-expandr/#comments</comments>
		<pubDate>Mon, 01 Apr 2013 18:47:06 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[diversions]]></category>
		<category><![CDATA[math]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2662</guid>
		<description><![CDATA[[I have been asked by the office of public affairs of the Institute for Advanced Study to publicize the following press release. L.T.] April 1, 2013. For immediate release. Cofounders Jean Bourgain and Peter Sarnak announce today the launch of eXpandr, a new venture that aims to become the world&#8217;s leading provider of expander graphs. [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2662&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><i>[I have been asked by the office of public affairs of the Institute for Advanced Study to publicize the following press release. L.T.]</i></p>
<p>April 1, 2013. For immediate release.</p>
<p>Cofounders Jean Bourgain and Peter Sarnak announce today the launch of <i>eXpandr</i>, a new venture that aims to become the world&#8217;s leading provider of expander graphs.</p>
<p>&#8220;We are excited about our mission to change the way the world uses expanders.&#8221; said CEO Guli Mars, who joined eXpandr after a distinguished career in several leading technology companies. &#8220;Expanders are vital to revenue-generating logarithms, and our technology will revolutionize a multi-billion dollar market.&#8221;</p>
<p>&#8220;Big data, disruption&#8221;, said Juan Raman, senior vice president for marketing. &#8220;Innovation, cloud computing&#8221;, Mr. Raman continued.</p>
<p>&#8220;Let p be a prime congruent to 1 modulo 4&#8243; said Jean Bourgain, cofounder and senior vice-president for analytic number theory, &#8220;and consider the irreducible representations of PSL(2,p).&#8221;</p>
<p><i>About the Institute for Advanced Study</i>. The Institute for Advanced Study is one of the world’s leading centers for theoretical research and intellectual inquiry. The Institute exists to encourage and support fundamental research in the sciences and humanities—the original, often speculative thinking that produces advances in knowledge that change the way we understand the world. Work at the Institute takes place in four Schools: Historical Studies, Mathematics, Natural Sciences and Social Science. It provides for the mentoring of scholars by a permanent Faculty of no more than 28, and it offers all who work there the freedom to undertake research that will make significant contributions in any of the broad range of fields in the sciences and humanities studied at the Institute.</p>
<p>The Institute, founded in 1930, is a private, independent academic institution located in Princeton, New Jersey. Its more than 6,000 former Members hold positions of intellectual and scientific leadership throughout the academic world. Some 33 Nobel Laureates and 38 out of 52 Fields Medalists, as well as many winners of the Wolf or MacArthur prizes, have been affiliated with the Institute.</p>
<p><i>About eXpandr</i>. eXpandr aims to disrupt the way the world uses expander graphs, and to become the leading commercial provider of expanders. eXpandr received $2 million in angel investing and will launch its first product by Summer 2013.</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2662/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2662/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2662&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/04/01/introducing-expandr/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>Proof of the Cheeger inequality in manifolds</title>
		<link>http://lucatrevisan.wordpress.com/2013/03/21/proof-of-the-cheeger-inequality-in-manifolds/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/03/21/proof-of-the-cheeger-inequality-in-manifolds/#comments</comments>
		<pubDate>Thu, 21 Mar 2013 14:00:08 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[math]]></category>
		<category><![CDATA[theory]]></category>
		<category><![CDATA[Cheeger inequality]]></category>
		<category><![CDATA[Laplacian]]></category>
		<category><![CDATA[manifolds]]></category>
		<category><![CDATA[spectral graph theory]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2650</guid>
		<description><![CDATA[Having (non-rigorously) defined the Laplacian operator in manifolds in the previous post, we turn to the proof of the Cheeger inequality in manifolds, which we restate below. Theorem 1 (Cheeger&#8217;s inequality) Let be an -dimensional smooth, compact, Riemann manifold without boundary with metric , let be the Laplace-Beltrami operator on , let be the eigenvalues [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2650&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>
 Having (non-rigorously) defined the Laplacian operator in manifolds in the previous post, we turn to the proof of the Cheeger inequality in manifolds, which we restate below.</p>
<blockquote><p><b>Theorem 1 (Cheeger&#8217;s inequality)</b> <em> Let <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> be an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional smooth, compact, Riemann manifold without boundary with metric <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' />, let <img src='http://s0.wp.com/latex.php?latex=%7BL%3A%3D+-+%7B%5Crm+div%7D+%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L:= - {&#92;rm div} &#92;nabla}' title='{L:= - {&#92;rm div} &#92;nabla}' class='latex' /> be the Laplace-Beltrami operator on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, let <img src='http://s0.wp.com/latex.php?latex=%7B0%3D%5Clambda_1+%5Cleq+%5Clambda_2+%5Cleq+%5Ccdots+%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{0=&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots }' title='{0=&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots }' class='latex' /> be the eigenvalues of <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' />, and define the <em>Cheeger constant</em> of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> to be</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28M%29%3A%3D+%5Cinf_%7BS%5Csubseteq+M+%3A+%5C+0+%3C+%5Cmu%28S%29+%5Cleq+%5Cfrac+12+%5Cmu%28M%29%7D+%5C+%5Cfrac%7B%5Cmu_%7Bn-1%7D%28%5Cpartial%28S%29%29%7D%7B%5Cmu%28S%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(M):= &#92;inf_{S&#92;subseteq M : &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(M)} &#92; &#92;frac{&#92;mu_{n-1}(&#92;partial(S))}{&#92;mu(S)} ' title='&#92;displaystyle  h(M):= &#92;inf_{S&#92;subseteq M : &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(M)} &#92; &#92;frac{&#92;mu_{n-1}(&#92;partial(S))}{&#92;mu(S)} ' class='latex' /></p>
<p>
where the <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial (S)}' title='{&#92;partial (S)}' class='latex' /> is the boundary of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu}' title='{&#92;mu}' class='latex' /> is the <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional measure, and <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu_%7Bn-1%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu_{n-1}}' title='{&#92;mu_{n-1}}' class='latex' /> is <img src='http://s0.wp.com/latex.php?latex=%7B%28n-1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(n-1)}' title='{(n-1)}' class='latex' />-th dimensional measure defined using <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' />. Then</p>
<p>
<a name="cheeger">
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle+++h%28M%29+%5Cleq+2+%5Csqrt%7B%5Clambda_2%7D+%5C+%5C+%5C+%5C+%5C+%281%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle   h(M) &#92;leq 2 &#92;sqrt{&#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (1)' title='&#92;displaystyle   h(M) &#92;leq 2 &#92;sqrt{&#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (1)' class='latex' /></p>
<p></a> </em></p></blockquote>
<p><p>
We begin by recalling the proof of the analogous result in graphs, and then we will repeat the same steps in the context of manifolds.</p>
<blockquote><p><b>Theorem 2 (Cheeger&#8217;s inequality in graphs)</b> <em> Let <img src='http://s0.wp.com/latex.php?latex=%7BG%3D%28V%2CE%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G=(V,E)}' title='{G=(V,E)}' class='latex' /> be a <img src='http://s0.wp.com/latex.php?latex=%7Bd%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{d}' title='{d}' class='latex' />-regular graph, <img src='http://s0.wp.com/latex.php?latex=%7BA%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A}' title='{A}' class='latex' /> be its adjacency matrix, <img src='http://s0.wp.com/latex.php?latex=%7BL%3A%3D+I+-+%5Cfrac+1d+A%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L:= I - &#92;frac 1d A}' title='{L:= I - &#92;frac 1d A}' class='latex' /> be its normalized Laplacian matrix, <img src='http://s0.wp.com/latex.php?latex=%7B0+%3D+%5Clambda_1+%5Cleq+%5Clambda_2+%5Cleq+%5Ccdots+%5Cleq+%5Clambda_%7B%7CV%7C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{0 = &#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_{|V|}}' title='{0 = &#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_{|V|}}' class='latex' /> be the eigenvalues of <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' />, and define <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29%3A%3D+d+%5Ccdot+%7CS%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S):= d &#92;cdot |S|}' title='{&#92;mu(S):= d &#92;cdot |S|}' class='latex' /> for every subset of vertices <img src='http://s0.wp.com/latex.php?latex=%7BS%5Csubseteq+V%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S&#92;subseteq V}' title='{S&#92;subseteq V}' class='latex' />. Define the conductance of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' /> as</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28G%29+%3A%3D+%5Cmin_%7BS%5Csubseteq+V%3A+%5C+0+%3C+%5Cmu%28S%29+%5Cleq+%5Cfrac+12+%5Cmu%28V%29+%7D+%5Cfrac%7B%7C+%5Cpartial+S%7C%7D%7B%5Cmu%28S%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(G) := &#92;min_{S&#92;subseteq V: &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V) } &#92;frac{| &#92;partial S|}{&#92;mu(S)} ' title='&#92;displaystyle  &#92;phi(G) := &#92;min_{S&#92;subseteq V: &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V) } &#92;frac{| &#92;partial S|}{&#92;mu(S)} ' class='latex' /></p>
<p> where <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S}' title='{&#92;partial S}' class='latex' /> is the number of edges with one endpoint in <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> and one endpoint in <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar S}' title='{&#92;bar S}' class='latex' />. Then
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28G%29+%5Cleq+%5Csqrt%7B2+%5Clambda_2%7D+%5C+%5C+%5C+%5C+%5C+%282%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (2)' title='&#92;displaystyle  &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (2)' class='latex' /></p>
<p> </em></p></blockquote>
<p>
<p><b>1. Proof the Cheeger inequality in graphs </b></p>
<p><p>
We will use the <em>variational characterization</em> of the eigenvalues of the Laplacian <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> of a graph <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' />.</p>
<p>
<a name="eqlambdaone">
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle+++%5Clambda_1+%3D+%5Cmin_%7Bf+%5Cin+%7B%5Cmathbb+R%7D%5Ev%7D+%5Cfrac+%7Bf%5ET+Lf%7D%7Bf%5ET+f%7D+%5C+%5C+%5C+%5C+%5C+%283%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle   &#92;lambda_1 = &#92;min_{f &#92;in {&#92;mathbb R}^v} &#92;frac {f^T Lf}{f^T f} &#92; &#92; &#92; &#92; &#92; (3)' title='&#92;displaystyle   &#92;lambda_1 = &#92;min_{f &#92;in {&#92;mathbb R}^v} &#92;frac {f^T Lf}{f^T f} &#92; &#92; &#92; &#92; &#92; (3)' class='latex' /></p>
<p></a> and if <img src='http://s0.wp.com/latex.php?latex=%7Bf_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_1}' title='{f_1}' class='latex' /> is a minimizer in the above expression then</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clambda_2+%3D+%5Cmin_%7Bf+%5Cin+%7B%5Cmathbb+R%7D%5EV%3A+%5C+f+%5Cperp+f_1%7D+%5Cfrac+%7Bf%5ET+Lf%7D%7Bf%5ET+f%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f &#92;in {&#92;mathbb R}^V: &#92; f &#92;perp f_1} &#92;frac {f^T Lf}{f^T f} ' title='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f &#92;in {&#92;mathbb R}^V: &#92; f &#92;perp f_1} &#92;frac {f^T Lf}{f^T f} ' class='latex' /></p>
<p> Following the definition of <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> we see that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++f%5ET+L+f+%3D+%5Cfrac+1d+%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Cf_u+-+f_v+%7C%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  f^T L f = &#92;frac 1d &#92;sum_{(u,v)&#92;in E} |f_u - f_v |^2 ' title='&#92;displaystyle  f^T L f = &#92;frac 1d &#92;sum_{(u,v)&#92;in E} |f_u - f_v |^2 ' class='latex' /></p>
<p> and so the minimum in <a href="#eqlambdaone">(3)</a> is 0, and it is achieved for <img src='http://s0.wp.com/latex.php?latex=%7Bf+%3D+%281%2C%5Ccdots%2C1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f = (1,&#92;cdots,1)}' title='{f = (1,&#92;cdots,1)}' class='latex' />. This means that</p>
<p>
<a name="eqlambdatwo">
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle+++%5Clambda_2+%3D+%5Cmin_%7Bf+%5Cin+%7B%5Cmathbb+R%7D%5EV%3A+%5C+%5Csum_v+f_v+%3D+0%7D+%5Cfrac+%7B%5Csum_%7B%28u%2Cv%29+%5Cin+E%7D+%7Cf_u-f_v%7C%5E2%7D%7Bd+%5Csum_v+f_v%5E2%7D+%5C+%5C+%5C+%5C+%5C+%284%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle   &#92;lambda_2 = &#92;min_{f &#92;in {&#92;mathbb R}^V: &#92; &#92;sum_v f_v = 0} &#92;frac {&#92;sum_{(u,v) &#92;in E} |f_u-f_v|^2}{d &#92;sum_v f_v^2} &#92; &#92; &#92; &#92; &#92; (4)' title='&#92;displaystyle   &#92;lambda_2 = &#92;min_{f &#92;in {&#92;mathbb R}^V: &#92; &#92;sum_v f_v = 0} &#92;frac {&#92;sum_{(u,v) &#92;in E} |f_u-f_v|^2}{d &#92;sum_v f_v^2} &#92; &#92; &#92; &#92; &#92; (4)' class='latex' /></p>
<p></a></p>
<p>
The expression in the right-hand-side of <a href="#eqlambdatwo">(4)</a> is an important one, and it is called the Rayleigh quotient of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />, which we will denote by <img src='http://s0.wp.com/latex.php?latex=%7BR%28f%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(f)}' title='{R(f)}' class='latex' />:</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28f%29%3A%3D+%5Cfrac+%7B%5Csum_%7B%28u%2Cv%29+%5Cin+E%7D+%7Cf_u-f_v%7C%5E2%7D%7Bd+%5Csum_v+f_v%5E2%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(f):= &#92;frac {&#92;sum_{(u,v) &#92;in E} |f_u-f_v|^2}{d &#92;sum_v f_v^2} ' title='&#92;displaystyle  R(f):= &#92;frac {&#92;sum_{(u,v) &#92;in E} |f_u-f_v|^2}{d &#92;sum_v f_v^2} ' class='latex' /></p>
<p>
It is also useful to consider the variant of the Rayleigh quotient where there are no squares; this does not have a standard name, so let us call it the <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' /> Rayleigh quotient and denote it by <img src='http://s0.wp.com/latex.php?latex=%7BR_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1}' title='{R_1}' class='latex' />:</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28g%29%3A%3D+%5Cfrac+%7B%5Csum_%7B%28u%2Cv%29+%5Cin+E%7D+%7Cg_u-g_v%7C%7D%7Bd+%5Csum_v+%7Cg_v%7C%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(g):= &#92;frac {&#92;sum_{(u,v) &#92;in E} |g_u-g_v|}{d &#92;sum_v |g_v|} ' title='&#92;displaystyle  R_1(g):= &#92;frac {&#92;sum_{(u,v) &#92;in E} |g_u-g_v|}{d &#92;sum_v |g_v|} ' class='latex' /></p>
<p>
The proof of the graph Cheeger inequality now continues with the proof of the following three facts.</p>
<blockquote><p><b>Lemma 3 (Rounding of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' /> embeddings)</b> <em> <a name="lmrounding"></a> For every non-negative vector <img src='http://s0.wp.com/latex.php?latex=%7Bg%5Cin+%7B%5Cmathbb+R%7D%5EV_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' title='{g&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' class='latex' /> there is a value <img src='http://s0.wp.com/latex.php?latex=%7Bt%5Cgeq+0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t&#92;geq 0}' title='{t&#92;geq 0}' class='latex' /> such that
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28%5C%7B+v%3A+g%28v%29+%3E+t+%5C%7D%29+%5Cleq+R_1%28g%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(&#92;{ v: g(v) &gt; t &#92;}) &#92;leq R_1(g) ' title='&#92;displaystyle  &#92;phi(&#92;{ v: g(v) &gt; t &#92;}) &#92;leq R_1(g) ' class='latex' /></p>
<p> </em></p></blockquote>
<p>
<blockquote><p><b>Lemma 4 (Embedding of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_2%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_2^2}' title='{&#92;ell_2^2}' class='latex' /> into <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' />)</b> <em> <a name="lmembed"></a> For every non-negative vector <img src='http://s0.wp.com/latex.php?latex=%7Bf%5Cin+%7B%5Cmathbb+R%7D%5EV_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' title='{f&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' class='latex' />, we have
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28f%5E2%29+%5Cleq+%5Csqrt%7B2+R%28f%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(f^2) &#92;leq &#92;sqrt{2 R(f)} ' title='&#92;displaystyle  R_1(f^2) &#92;leq &#92;sqrt{2 R(f)} ' class='latex' /></p>
<p> </em></p></blockquote>
<p>
<blockquote><p><b>Lemma 5 (From an eigenvector to a non-negative vector)</b> <em> <a name="lmadjust"></a> For every <img src='http://s0.wp.com/latex.php?latex=%7Bf%5Cin+%7B%5Cmathbb+R%7D%5EV%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#92;in {&#92;mathbb R}^V}' title='{f&#92;in {&#92;mathbb R}^V}' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=%7B%5Csum_v+f_v+%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;sum_v f_v =0}' title='{&#92;sum_v f_v =0}' class='latex' /> there is a non-negative <img src='http://s0.wp.com/latex.php?latex=%7Bf%27%5Cin+%7B%5Cmathbb+R%7D%5EV_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#039;&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' title='{f&#039;&#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28%5C%7B+v%3A+f%27%28v%29+%3E0+%5C%7D%29+%5Cleq+%5Cfrac+12+%5Cmu%28V%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(&#92;{ v: f&#039;(v) &gt;0 &#92;}) &#92;leq &#92;frac 12 &#92;mu(V)}' title='{&#92;mu(&#92;{ v: f&#039;(v) &gt;0 &#92;}) &#92;leq &#92;frac 12 &#92;mu(V)}' class='latex' /> and such that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28f%27%29+%5Cleq+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(f&#039;) &#92;leq R(f) ' title='&#92;displaystyle  R(f&#039;) &#92;leq R(f) ' class='latex' /></p>
<p> </em></p></blockquote>
<p><p>
Now let us start from a function <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> that optimizes <a href="#eqlambdatwo">(4)</a>, so that <img src='http://s0.wp.com/latex.php?latex=%7B%5Csum_v+f_v+%3D+0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;sum_v f_v = 0}' title='{&#92;sum_v f_v = 0}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28f%29+%3D+%5Clambda_2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(f) = &#92;lambda_2}' title='{R(f) = &#92;lambda_2}' class='latex' />, then apply Lemma <a href="#lmadjust">5</a> to find a function <img src='http://s0.wp.com/latex.php?latex=%7Bf%27%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#039;}' title='{f&#039;}' class='latex' /> such that the volume of the vertices having positive coordinates in <img src='http://s0.wp.com/latex.php?latex=%7Bf%27%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#039;}' title='{f&#039;}' class='latex' /> is at most <img src='http://s0.wp.com/latex.php?latex=%7B%5Cfrac+12+%5Cmu%28V%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;frac 12 &#92;mu(V)}' title='{&#92;frac 12 &#92;mu(V)}' class='latex' /> and such that <img src='http://s0.wp.com/latex.php?latex=%7BR%28f%27%29+%5Cleq+R%28f%29+%3D+%5Clambda_2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(f&#039;) &#92;leq R(f) = &#92;lambda_2}' title='{R(f&#039;) &#92;leq R(f) = &#92;lambda_2}' class='latex' />. Then consider the vector <img src='http://s0.wp.com/latex.php?latex=%7Bg%5Cin+%7B%5Cmathbb+R%7D%5EV%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g&#92;in {&#92;mathbb R}^V}' title='{g&#92;in {&#92;mathbb R}^V}' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=%7Bg_v+%3A%3D+f%27%5E2_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g_v := f&#039;^2_v}' title='{g_v := f&#039;^2_v}' class='latex' />; by Lemma <a href="#lmembed">4</a>, we have <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28g%29+%5Cleq+%5Csqrt%7B2+R%28f%27%29%7D+%5Cleq+%5Csqrt%7B2%5Clambda_2%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(g) &#92;leq &#92;sqrt{2 R(f&#039;)} &#92;leq &#92;sqrt{2&#92;lambda_2}}' title='{R_1(g) &#92;leq &#92;sqrt{2 R(f&#039;)} &#92;leq &#92;sqrt{2&#92;lambda_2}}' class='latex' />, and by Lemma <a href="#lmrounding">3</a> there is a threshold <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' /> such that the set <img src='http://s0.wp.com/latex.php?latex=%7BS%3A%3D+%5C%7B+v%3A+g%28v%29+%3E+t+%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S:= &#92;{ v: g(v) &gt; t &#92;}}' title='{S:= &#92;{ v: g(v) &gt; t &#92;}}' class='latex' /> has conductance <img src='http://s0.wp.com/latex.php?latex=%7Bh%28S%29+%5Cleq+%5Csqrt+%7B2%5Clambda_2%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{h(S) &#92;leq &#92;sqrt {2&#92;lambda_2}}' title='{h(S) &#92;leq &#92;sqrt {2&#92;lambda_2}}' class='latex' />. Since <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> is a subset of the vertices having positive coordinates in <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' />, we have <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29+%5Cleq+%5Cfrac+12+%5Cmu%28V%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V)}' title='{&#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V)}' class='latex' />, and so </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28G%29+%5Cleq+%5Csqrt%7B2+%5Clambda_2+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2 } ' title='&#92;displaystyle  &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2 } ' class='latex' /></p>
<p>
which is the Cheeger inequality for graphs. It remains to prove the three lemmas.</p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmrounding">3</a>. For each threshold <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />, define the set
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++S_t+%3A%3D+%5C%7B+v%3A+g_v+%3E+t+%5C%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  S_t := &#92;{ v: g_v &gt; t &#92;} ' title='&#92;displaystyle  S_t := &#92;{ v: g_v &gt; t &#92;} ' class='latex' /></p>
<p> The idea of the proof is that if we pick <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' /> at random then the probability that an edge belongs to <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S_t%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S_t}' title='{&#92;partial S_t}' class='latex' /> is proportional to <img src='http://s0.wp.com/latex.php?latex=%7B%7Cg_u+-+g_v%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|g_u - g_v|}' title='{|g_u - g_v|}' class='latex' /> and the probability that <img src='http://s0.wp.com/latex.php?latex=%7Bv%5Cin+S_t%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v&#92;in S_t}' title='{v&#92;in S_t}' class='latex' /> is proportional to <img src='http://s0.wp.com/latex.php?latex=%7B%7Cg_v%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|g_v|}' title='{|g_v|}' class='latex' />, so that the expected number of edges in <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S_t%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S_t}' title='{&#92;partial S_t}' class='latex' /> is proportional to the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28g%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(g)}' title='{R_1(g)}' class='latex' /> and the expected number of vertices in <img src='http://s0.wp.com/latex.php?latex=%7BS_t%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S_t}' title='{S_t}' class='latex' /> is proportional to the denominator of <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28g%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(g)}' title='{R_1(g)}' class='latex' />; if <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28g%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(g)}' title='{R_1(g)}' class='latex' /> is small, it is not possible for <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S_t%2F%5Cmu%28S_t%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S_t/&#92;mu(S_t)}' title='{&#92;partial S_t/&#92;mu(S_t)}' class='latex' /> to always be large for every <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />.</p>
<p>
To avoid having to normalize the range of <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' /> to be between <img src='http://s0.wp.com/latex.php?latex=%7B0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{0}' title='{0}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{1}' title='{1}' class='latex' />, instead of taking averages over a random choice of <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />, we will consider the integral over all values of <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />. We have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_0%5E%5Cinfty+%7C%5Cpartial+%28S_t%29+%7C+%7B%5Crm+d%7D+t+%3D+%5Csum_%7Bu%2Cv%7D+%7Cg_u+-+g_v+%7C+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_0^&#92;infty |&#92;partial (S_t) | {&#92;rm d} t = &#92;sum_{u,v} |g_u - g_v | ' title='&#92;displaystyle  &#92;int_0^&#92;infty |&#92;partial (S_t) | {&#92;rm d} t = &#92;sum_{u,v} |g_u - g_v | ' class='latex' /></p>
<p> because we can write <img src='http://s0.wp.com/latex.php?latex=%7B%7C%5Cpartial+%28S_t%29%7C+%3D+%5Csum_%7B%28u%2Cv%29+%5Cin+E%7D+I_%7Bu%2Cv%7D+%28t%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|&#92;partial (S_t)| = &#92;sum_{(u,v) &#92;in E} I_{u,v} (t)}' title='{|&#92;partial (S_t)| = &#92;sum_{(u,v) &#92;in E} I_{u,v} (t)}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7BI_%7Bu%2Cv%7D+%28t%29+%3D+1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{I_{u,v} (t) = 1}' title='{I_{u,v} (t) = 1}' class='latex' /> if <img src='http://s0.wp.com/latex.php?latex=%7B%28u%2Cv%29+%5Cin+%5Cpartial+S_t%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(u,v) &#92;in &#92;partial S_t}' title='{(u,v) &#92;in &#92;partial S_t}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BI_%7Bu%2Cv%7D%28t%29+%3D+0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{I_{u,v}(t) = 0}' title='{I_{u,v}(t) = 0}' class='latex' /> otherwise, and we see that only the values of <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' /> between <img src='http://s0.wp.com/latex.php?latex=%7Bg_u%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g_u}' title='{g_u}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bg_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g_v}' title='{g_v}' class='latex' /> make <img src='http://s0.wp.com/latex.php?latex=%7BI_%7Bu%2Cv%7D%28t%29+%3D1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{I_{u,v}(t) =1}' title='{I_{u,v}(t) =1}' class='latex' />, so <img src='http://s0.wp.com/latex.php?latex=%7B%5Cint_%7B0%7D%5E%5Cinfty+I_%7Bu%2Cv%7D+%28t%29+%7B%5Crm+d%7D+t+%3D+%7Cg_u+-+g_v%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;int_{0}^&#92;infty I_{u,v} (t) {&#92;rm d} t = |g_u - g_v|}' title='{&#92;int_{0}^&#92;infty I_{u,v} (t) {&#92;rm d} t = |g_u - g_v|}' class='latex' />.</p>
<p>
We also have
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_0%5E%5Cinfty+d+%7CS_t%7C+%7B%5Crm+d%7D+t+%3D+d+%5Csum_v+%7Cg_v%7C+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_0^&#92;infty d |S_t| {&#92;rm d} t = d &#92;sum_v |g_v| ' title='&#92;displaystyle  &#92;int_0^&#92;infty d |S_t| {&#92;rm d} t = d &#92;sum_v |g_v| ' class='latex' /></p>
<p>
and if we denote by <img src='http://s0.wp.com/latex.php?latex=%7Bt%5E%2A%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t^*}' title='{t^*}' class='latex' /> the threshold such that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cphi%28S_%7Bt%5E%2A%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;phi(S_{t^*})}' title='{&#92;phi(S_{t^*})}' class='latex' /> is smallest among all the <img src='http://s0.wp.com/latex.php?latex=%7B%5Cphi%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;phi(S)}' title='{&#92;phi(S)}' class='latex' />, then </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Csum_%7Bu%2Cv%7D+%7Cg_u+-+g_v+%7C+%3D+%5Cint_0%5E%5Cinfty+%7C%5Cpartial+%28S_t%29+%7C+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;sum_{u,v} |g_u - g_v | = &#92;int_0^&#92;infty |&#92;partial (S_t) | {&#92;rm d} t ' title='&#92;displaystyle  &#92;sum_{u,v} |g_u - g_v | = &#92;int_0^&#92;infty |&#92;partial (S_t) | {&#92;rm d} t ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cgeq+%5Cint_0%5E%5Cinfty+h%28S_%7Bt%5E%2A%7D%29+d%7CS_t%7C+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;geq &#92;int_0^&#92;infty h(S_{t^*}) d|S_t| {&#92;rm d} t ' title='&#92;displaystyle  &#92;geq &#92;int_0^&#92;infty h(S_{t^*}) d|S_t| {&#92;rm d} t ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+h%28S_%7Bt%5E%2A%7D%29+d+%5Csum_v+%7Cg_v%7C+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = h(S_{t^*}) d &#92;sum_v |g_v| ' title='&#92;displaystyle  = h(S_{t^*}) d &#92;sum_v |g_v| ' class='latex' /></p>
<p> so that
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28S_%7Bt%5E%2A%7D%29+%5Cleq+%5Cfrac+%7B+%5Csum_%7Bu%2Cv%7D+%7Cg_u+-+g_v+%7C+%7D%7Bd+%5Csum_v+%7Cg_v%7C+%7D+%3D+R_1%28g%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(S_{t^*}) &#92;leq &#92;frac { &#92;sum_{u,v} |g_u - g_v | }{d &#92;sum_v |g_v| } = R_1(g) ' title='&#92;displaystyle  h(S_{t^*}) &#92;leq &#92;frac { &#92;sum_{u,v} |g_u - g_v | }{d &#92;sum_v |g_v| } = R_1(g) ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmrounding">3</a>. Let us consider the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28f%5E2%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(f^2)}' title='{R_1(f^2)}' class='latex' />; it is:</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Cf%5E2_u+-+f%5E2_v%7C+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;sum_{(u,v)&#92;in E} |f^2_u - f^2_v| ' title='&#92;displaystyle  &#92;sum_{(u,v)&#92;in E} |f^2_u - f^2_v| ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Cf_u+-+f_v%7C+%5Ccdot+%28f_u+%2B+f_v%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;sum_{(u,v)&#92;in E} |f_u - f_v| &#92;cdot (f_u + f_v) ' title='&#92;displaystyle  = &#92;sum_{(u,v)&#92;in E} |f_u - f_v| &#92;cdot (f_u + f_v) ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cleq+%5Csqrt%7B%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Cf_u+-+f_v%7C%5E2%7D+%5Csqrt%7B+%5Csum_%7B%28u%2Cv%29%5Cin+E%7D%28f_u+%2B+f_v%29%5E2+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;leq &#92;sqrt{&#92;sum_{(u,v)&#92;in E} |f_u - f_v|^2} &#92;sqrt{ &#92;sum_{(u,v)&#92;in E}(f_u + f_v)^2 } ' title='&#92;displaystyle  &#92;leq &#92;sqrt{&#92;sum_{(u,v)&#92;in E} |f_u - f_v|^2} &#92;sqrt{ &#92;sum_{(u,v)&#92;in E}(f_u + f_v)^2 } ' class='latex' /></p>
<p> (we used Cauchy-Swarz)
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cleq+%5Csqrt%7BR%28f%29+%5Ccdot+d%5Csum_v+f_v%5E2%7D+%5Csqrt%7B+%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+2f_u%5E2+%2B+2f_v%5E2+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;leq &#92;sqrt{R(f) &#92;cdot d&#92;sum_v f_v^2} &#92;sqrt{ &#92;sum_{(u,v)&#92;in E} 2f_u^2 + 2f_v^2 } ' title='&#92;displaystyle  &#92;leq &#92;sqrt{R(f) &#92;cdot d&#92;sum_v f_v^2} &#92;sqrt{ &#92;sum_{(u,v)&#92;in E} 2f_u^2 + 2f_v^2 } ' class='latex' /></p>
<p> (we used the definition of <img src='http://s0.wp.com/latex.php?latex=%7BR_2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_2}' title='{R_2}' class='latex' /> and Cauchy-Swarz again)
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Csqrt%7BR%28f%29+%5Ccdot+d%5Csum_v+%7Cf_v%7C%5E2%7D+%5Csqrt%7B+2+d%5Csum_%7Bv%7D+f_v%5E2+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;sqrt{R(f) &#92;cdot d&#92;sum_v |f_v|^2} &#92;sqrt{ 2 d&#92;sum_{v} f_v^2 } ' title='&#92;displaystyle  = &#92;sqrt{R(f) &#92;cdot d&#92;sum_v |f_v|^2} &#92;sqrt{ 2 d&#92;sum_{v} f_v^2 } ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Csqrt%7B2+R%28f%29+%7D+%5Ccdot+d+%5Csum_v+f_v%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;sqrt{2 R(f) } &#92;cdot d &#92;sum_v f_v^2 ' title='&#92;displaystyle  = &#92;sqrt{2 R(f) } &#92;cdot d &#92;sum_v f_v^2 ' class='latex' /></p>
<p> And so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28f%5E2%29+%3D+%5Cfrac+%7B%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Cf%5E2_u+-+f%5E2_v%7C%7D%7Bd+%5Csum_v+f_v%5E2%7D+%5Cleq+%5Csqrt%7B2+R_2%28f%29+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(f^2) = &#92;frac {&#92;sum_{(u,v)&#92;in E} |f^2_u - f^2_v|}{d &#92;sum_v f_v^2} &#92;leq &#92;sqrt{2 R_2(f) } ' title='&#92;displaystyle  R_1(f^2) = &#92;frac {&#92;sum_{(u,v)&#92;in E} |f^2_u - f^2_v|}{d &#92;sum_v f_v^2} &#92;leq &#92;sqrt{2 R_2(f) } ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmadjust">5</a>. Let <img src='http://s0.wp.com/latex.php?latex=%7Bm%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{m}' title='{m}' class='latex' /> be the median of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />, and consider <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f}' title='{&#92;bar f}' class='latex' /> defined as <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f_v+%3A%3D+f_v+-+m%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f_v := f_v - m}' title='{&#92;bar f_v := f_v - m}' class='latex' />. We have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28%5Cbar+f%29+%5Cleq+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(&#92;bar f) &#92;leq R(f) ' title='&#92;displaystyle  R(&#92;bar f) &#92;leq R(f) ' class='latex' /></p>
<p> because the numerators of <img src='http://s0.wp.com/latex.php?latex=%7BR%28%5Cbar+f%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(&#92;bar f)}' title='{R(&#92;bar f)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28f%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(f)}' title='{R(f)}' class='latex' /> are the same (the additive term <img src='http://s0.wp.com/latex.php?latex=%7B-m%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{-m}' title='{-m}' class='latex' /> cancels). The denominators are such that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Csum_v+%5Cbar+f_v%5E2+%3D+%7C%7C+%5Cbar+f%7C%7C%5E2+%3D+%7C%7C+f%7C%7C%5E2+%2B+%7C%7C+-+m+%5Ccdot+%7B%5Cbf+1%7D+%7C%7C%5E2+%5Cgeq+%7C%7C+f%7C%7C%5E2+%3D+%5Csum_v+f_v%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;sum_v &#92;bar f_v^2 = || &#92;bar f||^2 = || f||^2 + || - m &#92;cdot {&#92;bf 1} ||^2 &#92;geq || f||^2 = &#92;sum_v f_v^2 ' title='&#92;displaystyle  &#92;sum_v &#92;bar f_v^2 = || &#92;bar f||^2 = || f||^2 + || - m &#92;cdot {&#92;bf 1} ||^2 &#92;geq || f||^2 = &#92;sum_v f_v^2 ' class='latex' /></p>
<p> because <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> and the vector <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+1%7D+%3D+%281%2C%5Cldots%2C1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf 1} = (1,&#92;ldots,1)}' title='{{&#92;bf 1} = (1,&#92;ldots,1)}' class='latex' /> are orthogonal, and so by Pythagoras&#8217;s theorem the length-squared of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f+%3D+f+-+m+%7B%5Cbf+1%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f = f - m {&#92;bf 1}}' title='{&#92;bar f = f - m {&#92;bf 1}}' class='latex' /> equals the length-squared of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> plus the length-squared of <img src='http://s0.wp.com/latex.php?latex=%7B-m+%7B%5Cbf+1%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{-m {&#92;bf 1}}' title='{-m {&#92;bf 1}}' class='latex' />.</p>
<p>
Let us define <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B_v+%3A%3D+%5Cmin%5C%7B+0%2C+%5Cbar+f_v%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+_v := &#92;min&#92;{ 0, &#92;bar f_v&#92;}}' title='{f^+_v := &#92;min&#92;{ 0, &#92;bar f_v&#92;}}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-_v+%3A%3D+%5Cmin+%5C%7B+0%2C+-%5Cbar+f_v%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-_v := &#92;min &#92;{ 0, -&#92;bar f_v&#92;}}' title='{f^-_v := &#92;min &#92;{ 0, -&#92;bar f_v&#92;}}' class='latex' /> so that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f+%3D+f%5E%2B+-+f%5E-%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f = f^+ - f^-}' title='{&#92;bar f = f^+ - f^-}' class='latex' />. We use the following fact:</p>
<blockquote><p><b>Fact 6</b> <em> Let <img src='http://s0.wp.com/latex.php?latex=%7Ba%2Cb+%5Cin+%7B%5Cmathbb+R%7D%5EV_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a,b &#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' title='{a,b &#92;in {&#92;mathbb R}^V_{&#92;geq 0}}' class='latex' /> be disjointly supported non-negative vectors (&#8220;disjointly supported&#8221; means that they are non-zero on disjoint subsets of coordinates), then
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin%5C%7B+R%28a%29+%2C+R%28b%29+%5C%7D+%5Cleq+R%28a-b%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min&#92;{ R(a) , R(b) &#92;} &#92;leq R(a-b) ' title='&#92;displaystyle  &#92;min&#92;{ R(a) , R(b) &#92;} &#92;leq R(a-b) ' class='latex' /></p>
<p> </em></p></blockquote>
<p> <em>Proof:</em> The numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' /> is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Ca_v+-+b_v+%2B+b_u+-+a_v%7C%5E2+%5Cgeq+%5Csum_%7B%28u%2Cv%29%5Cin+E%7D+%7Ca_v+-+a_u%7C%5E2+%2B+%7Cb_v+-+b_u%7C%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;sum_{(u,v)&#92;in E} |a_v - b_v + b_u - a_v|^2 &#92;geq &#92;sum_{(u,v)&#92;in E} |a_v - a_u|^2 + |b_v - b_u|^2 ' title='&#92;displaystyle  &#92;sum_{(u,v)&#92;in E} |a_v - b_v + b_u - a_v|^2 &#92;geq &#92;sum_{(u,v)&#92;in E} |a_v - a_u|^2 + |b_v - b_u|^2 ' class='latex' /></p>
<p> and, using orthogonality and Pythagoras&#8217;s theorem, the denominator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' /> is
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++d+%7C%7C+a-+b%7C%7C%5E2+%3D+d%7C%7Ca+%7C%7C%5E2+%2B+d%7C%7C+b%7C%7C%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  d || a- b||^2 = d||a ||^2 + d|| b||^2 ' title='&#92;displaystyle  d || a- b||^2 = d||a ||^2 + d|| b||^2 ' class='latex' /></p>
<p> The fact now follows from the inequality
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin+%5Cleft+%5C%7B+%5Cfrac+%7Bn_1%7D%7Bd_1%7D+%2C+%5Cfrac%7Bn_2%7D%7Bd_2%7D+%5Cright+%5C%7D+%5Cleq+%5Cfrac%7Bn_1%2Bn_2%7D%7Bd_1%2Bd_2%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min &#92;left &#92;{ &#92;frac {n_1}{d_1} , &#92;frac{n_2}{d_2} &#92;right &#92;} &#92;leq &#92;frac{n_1+n_2}{d_1+d_2} ' title='&#92;displaystyle  &#92;min &#92;left &#92;{ &#92;frac {n_1}{d_1} , &#92;frac{n_2}{d_2} &#92;right &#92;} &#92;leq &#92;frac{n_1+n_2}{d_1+d_2} ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
The lemma now follows by observing that <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+}' title='{f^+}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-}' title='{f^-}' class='latex' /> are non-negative and disjointly supported, so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin%5C%7B+R%28f%5E%2B%29+%2C+R%28f%5E-%29+%5C%7D+%5Cleq+R%28%5Cbar+f%29+%5Cleq+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min&#92;{ R(f^+) , R(f^-) &#92;} &#92;leq R(&#92;bar f) &#92;leq R(f) ' title='&#92;displaystyle  &#92;min&#92;{ R(f^+) , R(f^-) &#92;} &#92;leq R(&#92;bar f) &#92;leq R(f) ' class='latex' /></p>
<p> and that both <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+}' title='{f^+}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-}' title='{f^-}' class='latex' /> have at most <img src='http://s0.wp.com/latex.php?latex=%7Bn%2F2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n/2}' title='{n/2}' class='latex' /> non-zero coordinate. <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
<p><b>2. Proof of the Cheeger inequality in manifolds </b></p>
<p><p>
We will now translate the proof of the graph Cheeger inequality to the setting of manifolds.</p>
<p>
As you may remember, we started off by saying that <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> is symmetric and so all its eigenvalues are real and they are given by the variational characterization. Now we are already in trouble because the operator <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> on manifolds cannot be thought of as a matrix, so what does it mean for it to be symmetric? The consequence of symmetry that is exploited in the analysis of the spectrum of symmetric matrices is the fact that if <img src='http://s0.wp.com/latex.php?latex=%7BA%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A}' title='{A}' class='latex' /> is symmetric, then for every <img src='http://s0.wp.com/latex.php?latex=%7Bx%2Cy%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x,y}' title='{x,y}' class='latex' /> we have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+x%2CAy+%5Crangle+%3D+x%5ET+Ay+%3D+%28A%5ETx%29%5ETy+%3D+%28Ax%29%5ETy+%3D+%5Clangle+Ax%2Cy+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle x,Ay &#92;rangle = x^T Ay = (A^Tx)^Ty = (Ax)^Ty = &#92;langle Ax,y &#92;rangle ' title='&#92;displaystyle  &#92;langle x,Ay &#92;rangle = x^T Ay = (A^Tx)^Ty = (Ax)^Ty = &#92;langle Ax,y &#92;rangle ' class='latex' /></p>
<p>
and the property <img src='http://s0.wp.com/latex.php?latex=%7B%5Clangle+x%2C+Ay+%5Crangle+%3D+%5Clangle+Ax+%2C+y+%5Crangle%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;langle x, Ay &#92;rangle = &#92;langle Ax , y &#92;rangle}' title='{&#92;langle x, Ay &#92;rangle = &#92;langle Ax , y &#92;rangle}' class='latex' /> makes no references to coordinates, and it is well defined even for linear operators over infinite-dimensional spaces, provided that there is a notion of inner product. If we the define the inner product</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+f%2Cg+%5Crangle+%3A%3D+%5Cint_M+f%28x%29%5Ccdot+g%28x%29+%5C+%7B%5Crm+d%7D+%5Cmu%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle f,g &#92;rangle := &#92;int_M f(x)&#92;cdot g(x) &#92; {&#92;rm d} &#92;mu(x) ' title='&#92;displaystyle  &#92;langle f,g &#92;rangle := &#92;int_M f(x)&#92;cdot g(x) &#92; {&#92;rm d} &#92;mu(x) ' class='latex' /></p>
<p>
on functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' />, and more generally</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+f%2Cg+%5Crangle+%3A%3D+%5Cint_M+%5Clangle+f%28x%29%2C+g%28x%29%5Crangle_X+%5C+%7B%5Crm+d%7D+%5Cmu%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle f,g &#92;rangle := &#92;int_M &#92;langle f(x), g(x)&#92;rangle_X &#92; {&#92;rm d} &#92;mu(x) ' title='&#92;displaystyle  &#92;langle f,g &#92;rangle := &#92;int_M &#92;langle f(x), g(x)&#92;rangle_X &#92; {&#92;rm d} &#92;mu(x) ' class='latex' /></p>
<p>
for functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+X%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow X}' title='{f: M &#92;rightarrow X}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7BX%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{X}' title='{X}' class='latex' /> is a vector space with inner product <img src='http://s0.wp.com/latex.php?latex=%7B%5Clangle+%5Ccdot%2C%5Ccdot%2C%5Crangle_X%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;langle &#92;cdot,&#92;cdot,&#92;rangle_X}' title='{&#92;langle &#92;cdot,&#92;cdot,&#92;rangle_X}' class='latex' />, then we can say that an operator <img src='http://s0.wp.com/latex.php?latex=%7BA%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A}' title='{A}' class='latex' /> is <em>self-adjoint</em> if </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+f%2C+Ag+%5Crangle+%3D+%5Clangle+Af+%2Cg+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle f, Ag &#92;rangle = &#92;langle Af ,g &#92;rangle ' title='&#92;displaystyle  &#92;langle f, Ag &#92;rangle = &#92;langle Af ,g &#92;rangle ' class='latex' /></p>
<p> for all (appropriately restricted) functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%2Cg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f,g}' title='{f,g}' class='latex' />. If <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> is compact, this property is true for the Laplacian, and, in particular, <img src='http://s0.wp.com/latex.php?latex=%7B-%7B%5Crm+div%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{-{&#92;rm div}}' title='{-{&#92;rm div}}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla}' title='{&#92;nabla}' class='latex' /> are adjoints of each others, that is,</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+%5Cnabla+f%2C+g+%5Crangle+%3D+%5Clangle+f%2C+-+%7B%5Crm+div%7D+g+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle &#92;nabla f, g &#92;rangle = &#92;langle f, - {&#92;rm div} g &#92;rangle ' title='&#92;displaystyle  &#92;langle &#92;nabla f, g &#92;rangle = &#92;langle f, - {&#92;rm div} g &#92;rangle ' class='latex' /></p>
<p> (The discrete analog would be that <img src='http://s0.wp.com/latex.php?latex=%7BC%5ET%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{C^T}' title='{C^T}' class='latex' /> is the transpose of <img src='http://s0.wp.com/latex.php?latex=%7BC%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{C}' title='{C}' class='latex' />.)</p>
<p>
Self-adjointness (and appropriate conditions on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />) imply a version of the spectral theorem and of the variational characterization. In particular, all eigenvalues of <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> are real, and if there is a minimum one then it is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clambda_1+%3D+%5Cmin_%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D+%5Cfrac+%7B%5Clangle+f%2C+Lf+%5Crangle%7D%7B%5Clangle+f%2Cf%5Crangle%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;lambda_1 = &#92;min_{f: M &#92;rightarrow {&#92;mathbb R}} &#92;frac {&#92;langle f, Lf &#92;rangle}{&#92;langle f,f&#92;rangle} ' title='&#92;displaystyle  &#92;lambda_1 = &#92;min_{f: M &#92;rightarrow {&#92;mathbb R}} &#92;frac {&#92;langle f, Lf &#92;rangle}{&#92;langle f,f&#92;rangle} ' class='latex' /></p>
<p> and if <img src='http://s0.wp.com/latex.php?latex=%7Bf_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_1}' title='{f_1}' class='latex' /> is a minimizer of the above, then
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clambda_2+%3D+%5Cmin_%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%2C%5C+%5Clangle+f%2C+f_1+%5Crangle+%3D+0%7D+%5Cfrac+%7B%5Clangle+f%2C+Lf+%5Crangle%7D%7B%5Clangle+f%2Cf%5Crangle%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f: M &#92;rightarrow {&#92;mathbb R},&#92; &#92;langle f, f_1 &#92;rangle = 0} &#92;frac {&#92;langle f, Lf &#92;rangle}{&#92;langle f,f&#92;rangle} ' title='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f: M &#92;rightarrow {&#92;mathbb R},&#92; &#92;langle f, f_1 &#92;rangle = 0} &#92;frac {&#92;langle f, Lf &#92;rangle}{&#92;langle f,f&#92;rangle} ' class='latex' /></p>
<p>
(The minimization is quantified over all functions that are square-integrable, and the minimum is achieved because if <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> is compact then the space of such functions is also compact and the cost function that we are minimizing is continuous. In this post, whenever we talk about &#8220;all functions,&#8221; it should be understood that we are restricting to whatever space of functions makes sense in the context.)</p>
<p>
From the property that <img src='http://s0.wp.com/latex.php?latex=%7B-%7B%5Crm+div%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{-{&#92;rm div}}' title='{-{&#92;rm div}}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla}' title='{&#92;nabla}' class='latex' /> are adjoint, we have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+f%2C+Lf+%5Crangle+%3D+%5Clangle+f%2C+-%7B%5Crm+div%7D+%5Cnabla+f+%5Crangle+%3D+%5Clangle+%5Cnabla+f%2C%5Cnabla+f+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle f, Lf &#92;rangle = &#92;langle f, -{&#92;rm div} &#92;nabla f &#92;rangle = &#92;langle &#92;nabla f,&#92;nabla f &#92;rangle ' title='&#92;displaystyle  &#92;langle f, Lf &#92;rangle = &#92;langle f, -{&#92;rm div} &#92;nabla f &#92;rangle = &#92;langle &#92;nabla f,&#92;nabla f &#92;rangle ' class='latex' /></p>
<p> so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clambda_1+%3D+%5Cmin_%7Bf%3AM+%5Crightarrow+%7B%5Cmathbb+R%7D%7D+%5Cfrac%7B+%5Cint_M+%5Clangle+%5Cnabla+f%28x%29%2C%5Cnabla+f%28x%29+%5Crangle+%5C+%7B%5Crm+d%7D+%5Cmu%28x%29+%7D+%7B%5Cint+M+f%5E2%28x%29+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;lambda_1 = &#92;min_{f:M &#92;rightarrow {&#92;mathbb R}} &#92;frac{ &#92;int_M &#92;langle &#92;nabla f(x),&#92;nabla f(x) &#92;rangle &#92; {&#92;rm d} &#92;mu(x) } {&#92;int M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} ' title='&#92;displaystyle  &#92;lambda_1 = &#92;min_{f:M &#92;rightarrow {&#92;mathbb R}} &#92;frac{ &#92;int_M &#92;langle &#92;nabla f(x),&#92;nabla f(x) &#92;rangle &#92; {&#92;rm d} &#92;mu(x) } {&#92;int M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} ' class='latex' /></p>
<p> where the Rayleigh quotient</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28f%29%3A%3D+%5Cfrac%7B+%5Cint_M+%5Clangle+%5Cnabla+f%28x%29%2C%5Cnabla+f%28x%29+%5Crangle+%5C+%7B%5Crm+d%7D+%5Cmu%28x%29+%7D+%7B%5Cint+M+f%5E2%28x%29+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D+%3D+%5Cfrac+%7B%5Cint_M+%7C%7C%5Cnabla+f%28x%29%7C%7C%5E2+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D%7B%5Cint_M+f%5E2%28x%29+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(f):= &#92;frac{ &#92;int_M &#92;langle &#92;nabla f(x),&#92;nabla f(x) &#92;rangle &#92; {&#92;rm d} &#92;mu(x) } {&#92;int M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} = &#92;frac {&#92;int_M ||&#92;nabla f(x)||^2 &#92; {&#92;rm d} &#92;mu (x)}{&#92;int_M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} ' title='&#92;displaystyle  R(f):= &#92;frac{ &#92;int_M &#92;langle &#92;nabla f(x),&#92;nabla f(x) &#92;rangle &#92; {&#92;rm d} &#92;mu(x) } {&#92;int M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} = &#92;frac {&#92;int_M ||&#92;nabla f(x)||^2 &#92; {&#92;rm d} &#92;mu (x)}{&#92;int_M f^2(x) &#92; {&#92;rm d} &#92;mu (x)} ' class='latex' /></p>
<p> is always non-negative, and it is zero for constant <img src='http://s0.wp.com/latex.php?latex=%7Bf%5Cequiv+1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#92;equiv 1}' title='{f&#92;equiv 1}' class='latex' />, so we see that <img src='http://s0.wp.com/latex.php?latex=%7B%5Clambda_1%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;lambda_1=0}' title='{&#92;lambda_1=0}' class='latex' /> and</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clambda_2+%3D+%5Cmin_%7Bf%3AM+%5Crightarrow+%7B%5Cmathbb+R%7D+%3A+%5Cint_M+f%3D0+%5C+%7B%5Crm+d%7D+%5Cmu%7D+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f:M &#92;rightarrow {&#92;mathbb R} : &#92;int_M f=0 &#92; {&#92;rm d} &#92;mu} R(f) ' title='&#92;displaystyle  &#92;lambda_2 = &#92;min_{f:M &#92;rightarrow {&#92;mathbb R} : &#92;int_M f=0 &#92; {&#92;rm d} &#92;mu} R(f) ' class='latex' /></p>
<p>
By analogy with the graph case, we define the &#8220;<img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' /> Rayleigh quotient&#8221;</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28g%29+%3A%3D+%5Cfrac+%7B%5Cint_M+%7C%7C%5Cnabla+g%28x%29%7C%7C+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D%7B%5Cint_M+%7Cg%28x%29%7C+%5C+%7B%5Crm+d%7D+%5Cmu+%28x%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(g) := &#92;frac {&#92;int_M ||&#92;nabla g(x)|| &#92; {&#92;rm d} &#92;mu (x)}{&#92;int_M |g(x)| &#92; {&#92;rm d} &#92;mu (x)} ' title='&#92;displaystyle  R_1(g) := &#92;frac {&#92;int_M ||&#92;nabla g(x)|| &#92; {&#92;rm d} &#92;mu (x)}{&#92;int_M |g(x)| &#92; {&#92;rm d} &#92;mu (x)} ' class='latex' /></p>
<p>
And we can prove the analogs of the lemmas that we proved for graphs.</p>
<blockquote><p><b>Lemma 7 (Rounding of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' /> embeddings)</b> <em> <a name="lmmrounding"></a> For every non-negative function <img src='http://s0.wp.com/latex.php?latex=%7Bg%3A+V+%5Crightarrow+%7B%5Cmathbb+R%7D_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g: V &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' title='{g: V &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' class='latex' /> there is a value <img src='http://s0.wp.com/latex.php?latex=%7Bt%5Cgeq+0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t&#92;geq 0}' title='{t&#92;geq 0}' class='latex' /> such that
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28%5C%7B+x%3A+g%28x%29+%3E+t+%5C%7D%29+%5Cleq+R_1%28g%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(&#92;{ x: g(x) &gt; t &#92;}) &#92;leq R_1(g) ' title='&#92;displaystyle  h(&#92;{ x: g(x) &gt; t &#92;}) &#92;leq R_1(g) ' class='latex' /></p>
<p> </em></p></blockquote>
<p><p>
where the Cheeger constant <img src='http://s0.wp.com/latex.php?latex=%7Bh%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{h(S)}' title='{h(S)}' class='latex' /> of a subset <img src='http://s0.wp.com/latex.php?latex=%7BS%5Csubseteq+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S&#92;subseteq M}' title='{S&#92;subseteq M}' class='latex' /> of the manifold is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28S%29+%3A%3D+%5Cfrac%7B%5Cmu_%7Bn-1%7D+%28%5Cpartial+S%29%7D%7B%5Cmu%28S%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(S) := &#92;frac{&#92;mu_{n-1} (&#92;partial S)}{&#92;mu(S)} ' title='&#92;displaystyle  h(S) := &#92;frac{&#92;mu_{n-1} (&#92;partial S)}{&#92;mu(S)} ' class='latex' /></p>
<blockquote><p><b>Lemma 8 (Embedding of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_2%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_2^2}' title='{&#92;ell_2^2}' class='latex' /> into <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' />)</b> <em> <a name="lmmembed"></a> For every non-negative function <img src='http://s0.wp.com/latex.php?latex=%7Bf%3B+m+%5Crightarrow+%7B%5Cmathbb+R%7D_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f; m &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' title='{f; m &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' class='latex' />, we have
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28f%5E2%29+%5Cleq+%5Csqrt%7B2+R%28f%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(f^2) &#92;leq &#92;sqrt{2 R(f)} ' title='&#92;displaystyle  R_1(f^2) &#92;leq &#92;sqrt{2 R(f)} ' class='latex' /></p>
<p> </em></p></blockquote>
<p>
<blockquote><p><b>Lemma 9 (From an eigenfunction to a non-negative function)</b> <em> <a name="lmmadjust"></a> For every function <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+R%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow R}' title='{f: M &#92;rightarrow R}' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cint_M+f+%5C+%7B%5Crm+d%7D+%5Cmu+%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;int_M f &#92; {&#92;rm d} &#92;mu =0}' title='{&#92;int_M f &#92; {&#92;rm d} &#92;mu =0}' class='latex' /> there is a non-negative <img src='http://s0.wp.com/latex.php?latex=%7Bf%27%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#039;: M &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' title='{f&#039;: M &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' class='latex' /> such that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28%5C%7B+x%3A+f%27%28x%29+%3E0+%5C%7D%29+%5Cleq+%5Cfrac+12+%5Cmu%28V%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(&#92;{ x: f&#039;(x) &gt;0 &#92;}) &#92;leq &#92;frac 12 &#92;mu(V)}' title='{&#92;mu(&#92;{ x: f&#039;(x) &gt;0 &#92;}) &#92;leq &#92;frac 12 &#92;mu(V)}' class='latex' /> and such that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28f%27%29+%5Cleq+R_2%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(f&#039;) &#92;leq R_2(f) ' title='&#92;displaystyle  R(f&#039;) &#92;leq R_2(f) ' class='latex' /></p>
<p> </em></p></blockquote>
<p><p>
Let us see the proof of these lemmas.</p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmmrounding">7</a>. For each threshold <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />, define the set
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++S_t+%3A%3D+%5C%7B+x%3A+g%28x%29+%3E+t+%5C%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  S_t := &#92;{ x: g(x) &gt; t &#92;} ' title='&#92;displaystyle  S_t := &#92;{ x: g(x) &gt; t &#92;} ' class='latex' /></p>
<p> Let <img src='http://s0.wp.com/latex.php?latex=%7Bt%2A%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t*}' title='{t*}' class='latex' /> be a threshold for which <img src='http://s0.wp.com/latex.php?latex=%7Bh%28S_%7Bt%2A%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{h(S_{t*})}' title='{h(S_{t*})}' class='latex' /> is minimized</p>
<p>
We will integrate the numerator and denominator of <img src='http://s0.wp.com/latex.php?latex=%7Bh%28S_t%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{h(S_t)}' title='{h(S_t)}' class='latex' /> over all <img src='http://s0.wp.com/latex.php?latex=%7Bt%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{t}' title='{t}' class='latex' />. The <em>coarea formula</em> for nonnegative functions is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7C%7C+%5Cnabla+g+%7C%7C+%7B%5Crm+d%7D+%5Cmu+%3D+%5Cint_%7B0%7D%5E%5Cinfty+%5Cmu_%7Bn-1%7D+%28+%5Cpartial+%5C%7B+x%3A+g%28x%29+%3E+t+%5C%7D%29+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M || &#92;nabla g || {&#92;rm d} &#92;mu = &#92;int_{0}^&#92;infty &#92;mu_{n-1} ( &#92;partial &#92;{ x: g(x) &gt; t &#92;}) {&#92;rm d} t ' title='&#92;displaystyle  &#92;int_M || &#92;nabla g || {&#92;rm d} &#92;mu = &#92;int_{0}^&#92;infty &#92;mu_{n-1} ( &#92;partial &#92;{ x: g(x) &gt; t &#92;}) {&#92;rm d} t ' class='latex' /></p>
<p> and we also have
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7Cg%7C+%7B%5Crm+d%7D+%5Cmu+%3D+%5Cint_%7B0%7D%5E%5Cinfty+%5Cmu+%28+%5C%7B+x%3A+g%28x%29+%3E+t+%5C%7D%29+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M |g| {&#92;rm d} &#92;mu = &#92;int_{0}^&#92;infty &#92;mu ( &#92;{ x: g(x) &gt; t &#92;}) {&#92;rm d} t ' title='&#92;displaystyle  &#92;int_M |g| {&#92;rm d} &#92;mu = &#92;int_{0}^&#92;infty &#92;mu ( &#92;{ x: g(x) &gt; t &#92;}) {&#92;rm d} t ' class='latex' /></p>
<p>
which combine to</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7C%7C+%5Cnabla+g+%7C%7C+%7B%5Crm+d%7D+t+%3D+%5Cint_0%5E%5Cinfty+%5Cmu_%7Bn-1%7D+%28+%5Cpartial+S_t%29+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M || &#92;nabla g || {&#92;rm d} t = &#92;int_0^&#92;infty &#92;mu_{n-1} ( &#92;partial S_t) {&#92;rm d} t ' title='&#92;displaystyle  &#92;int_M || &#92;nabla g || {&#92;rm d} t = &#92;int_0^&#92;infty &#92;mu_{n-1} ( &#92;partial S_t) {&#92;rm d} t ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Cint_0%5E%5Cinfty+h%28S_t%29+%5Cmu%28S_t%29+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;int_0^&#92;infty h(S_t) &#92;mu(S_t) {&#92;rm d} t ' title='&#92;displaystyle  = &#92;int_0^&#92;infty h(S_t) &#92;mu(S_t) {&#92;rm d} t ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cgeq+h%28S_%7Bt%5E%2A%7D%29+%5Cint_0%5E%5Cinfty+%5Cmu%28S_t%29+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;geq h(S_{t^*}) &#92;int_0^&#92;infty &#92;mu(S_t) {&#92;rm d} t ' title='&#92;displaystyle  &#92;geq h(S_{t^*}) &#92;int_0^&#92;infty &#92;mu(S_t) {&#92;rm d} t ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+h%28S_%7Bt%5E%2A%7D%29+%5Cint_M+g+%7B%5Crm+d%7D+t+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = h(S_{t^*}) &#92;int_M g {&#92;rm d} t ' title='&#92;displaystyle  = h(S_{t^*}) &#92;int_M g {&#92;rm d} t ' class='latex' /></p>
<p>
so that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28S_%7Bt%5E%2A%7D%29+%5Cleq+%5Cfrac%7B%5Cint_M+%7C%7C+%5Cnabla+g+%7C%7C+%7B%5Crm+d%7D+t+%7D%7B+%5Cint_M+g+%7B%5Crm+d%7D+t%7D+%3D+R_1%28g%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(S_{t^*}) &#92;leq &#92;frac{&#92;int_M || &#92;nabla g || {&#92;rm d} t }{ &#92;int_M g {&#92;rm d} t} = R_1(g) ' title='&#92;displaystyle  h(S_{t^*}) &#92;leq &#92;frac{&#92;int_M || &#92;nabla g || {&#92;rm d} t }{ &#92;int_M g {&#92;rm d} t} = R_1(g) ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmmembed">8</a>. Let us consider the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR_1%28f%5E2%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R_1(f^2)}' title='{R_1(f^2)}' class='latex' />; it is:</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7C%7C+%5Cnabla+f%5E2%7C%7C+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M || &#92;nabla f^2|| {&#92;rm d} &#92;mu ' title='&#92;displaystyle  &#92;int_M || &#92;nabla f^2|| {&#92;rm d} &#92;mu ' class='latex' /></p>
<p> We can apply the chain rule, and see that
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cnabla+f%5E2%28x%29+%3D+2f%28x%29+%5Ccdot+%5Cnabla+f%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;nabla f^2(x) = 2f(x) &#92;cdot &#92;nabla f(x) ' title='&#92;displaystyle  &#92;nabla f^2(x) = 2f(x) &#92;cdot &#92;nabla f(x) ' class='latex' /></p>
<p> which implies
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7C%7C+%5Cnabla+f%5E2+%7C%7C+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M || &#92;nabla f^2 || {&#92;rm d} &#92;mu ' title='&#92;displaystyle  &#92;int_M || &#92;nabla f^2 || {&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Cint_M+%7C%7C+2f%28x%29+%5Cnabla+f%28x%29%7C%7C+%7B%5Crm+d%7D+%5Cmu%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;int_M || 2f(x) &#92;nabla f(x)|| {&#92;rm d} &#92;mu(x) ' title='&#92;displaystyle  = &#92;int_M || 2f(x) &#92;nabla f(x)|| {&#92;rm d} &#92;mu(x) ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Cint_M+2%7Cf%28x%29%7C+%5Ccdot+%7C%7C%5Cnabla+f%28x%29%7C%7C+%7B%5Crm+d%7D+%5Cmu+%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;int_M 2|f(x)| &#92;cdot ||&#92;nabla f(x)|| {&#92;rm d} &#92;mu (x) ' title='&#92;displaystyle  = &#92;int_M 2|f(x)| &#92;cdot ||&#92;nabla f(x)|| {&#92;rm d} &#92;mu (x) ' class='latex' /></p>
<p> and, after applying Caucy-Swarz,
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cleq+%5Csqrt%7B%5Cint_M+4+f%5E2%28x%29+%7B%5Crm+d%7D+%5Cmu%28x%29%7D+%5Ccdot+%5Csqrt%7B%5Cint_M+%7C%7C%5Cnabla+f%28x%29%7C%7C%5E2+%7B%5Crm+d%7D+%5Cmu%28x%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;leq &#92;sqrt{&#92;int_M 4 f^2(x) {&#92;rm d} &#92;mu(x)} &#92;cdot &#92;sqrt{&#92;int_M ||&#92;nabla f(x)||^2 {&#92;rm d} &#92;mu(x)} ' title='&#92;displaystyle  &#92;leq &#92;sqrt{&#92;int_M 4 f^2(x) {&#92;rm d} &#92;mu(x)} &#92;cdot &#92;sqrt{&#92;int_M ||&#92;nabla f(x)||^2 {&#92;rm d} &#92;mu(x)} ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+2+%5Ccdot+%5Cleft%28+%5Cint_M+f%5E2+%7B%5Crm+d%7D+%5Cmu+%5Cright%29+%5Ccdot+%5Csqrt%7B+R%28f%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = 2 &#92;cdot &#92;left( &#92;int_M f^2 {&#92;rm d} &#92;mu &#92;right) &#92;cdot &#92;sqrt{ R(f)} ' title='&#92;displaystyle  = 2 &#92;cdot &#92;left( &#92;int_M f^2 {&#92;rm d} &#92;mu &#92;right) &#92;cdot &#92;sqrt{ R(f)} ' class='latex' /></p>
<p>
And so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R_1%28f%5E2%29+%5Cleq+2+%5Csqrt%7BR_2%28f%29+%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R_1(f^2) &#92;leq 2 &#92;sqrt{R_2(f) } ' title='&#92;displaystyle  R_1(f^2) &#92;leq 2 &#92;sqrt{R_2(f) } ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
<em>Proof:</em>  of Lemma <a href="#lmmadjust">9</a>. Let <img src='http://s0.wp.com/latex.php?latex=%7Bm%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{m}' title='{m}' class='latex' /> be a median of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />, and consider <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f}' title='{&#92;bar f}' class='latex' /> defined as <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f%28x%29+%3A%3D+f%28x%29+-+m%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f(x) := f(x) - m}' title='{&#92;bar f(x) := f(x) - m}' class='latex' />. We have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++R%28%5Cbar+f%29+%5Cleq+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  R(&#92;bar f) &#92;leq R(f) ' title='&#92;displaystyle  R(&#92;bar f) &#92;leq R(f) ' class='latex' /></p>
<p> because the numerators of <img src='http://s0.wp.com/latex.php?latex=%7BR%28%5Cbar+f%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(&#92;bar f)}' title='{R(&#92;bar f)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28f%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(f)}' title='{R(f)}' class='latex' /> are the same (the derivatives of functions that differ by a constant are identical) and the denominators are such that</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%5Cbar+f%5E2%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M &#92;bar f^2{&#92;rm d} &#92;mu ' title='&#92;displaystyle  &#92;int_M &#92;bar f^2{&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Cint_M+f%5E2+-+2mf+%2B+m%5E2+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;int_M f^2 - 2mf + m^2 {&#92;rm d} &#92;mu ' title='&#92;displaystyle  = &#92;int_M f^2 - 2mf + m^2 {&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%5Cint_M+f%5E2+%2B+m%5E2+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = &#92;int_M f^2 + m^2 {&#92;rm d} &#92;mu ' title='&#92;displaystyle  = &#92;int_M f^2 + m^2 {&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cgeq+%5Cint_M+f%5E2+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;geq &#92;int_M f^2 {&#92;rm d} &#92;mu ' title='&#92;displaystyle  &#92;geq &#92;int_M f^2 {&#92;rm d} &#92;mu ' class='latex' /></p>
<p> where we used the fact the integral of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> is zero.</p>
<p>
Let us define <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B%28x%29+%3A%3D+%5Cmin%5C%7B+0%2C+%5Cbar+f%28x%29%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+(x) := &#92;min&#92;{ 0, &#92;bar f(x)&#92;}}' title='{f^+(x) := &#92;min&#92;{ 0, &#92;bar f(x)&#92;}}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-_v+%3A%3D+%5Cmin+%5C%7B+0%2C+-%5Cbar+f%28x%29%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-_v := &#92;min &#92;{ 0, -&#92;bar f(x)&#92;}}' title='{f^-_v := &#92;min &#92;{ 0, -&#92;bar f(x)&#92;}}' class='latex' /> so that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cbar+f%28x%29+%3D+f%5E%2B%28x%29+-+f%5E-%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;bar f(x) = f^+(x) - f^-(x)}' title='{&#92;bar f(x) = f^+(x) - f^-(x)}' class='latex' />. We use the following fact:</p>
<blockquote><p><b>Fact 10</b> <em> Let <img src='http://s0.wp.com/latex.php?latex=%7Ba%2Cb+%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D_%7B%5Cgeq+0%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a,b : M &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' title='{a,b : M &#92;rightarrow {&#92;mathbb R}_{&#92;geq 0}}' class='latex' /> be disjointly supported non-negative functions (&#8220;disjointly supported&#8221; means that they are non-zero on disjoint subsets of inputs), then
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin%5C%7B+R%28a%29+%2C+R%28b%29+%5C%7D+%5Cleq+R%28a-b%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min&#92;{ R(a) , R(b) &#92;} &#92;leq R(a-b) ' title='&#92;displaystyle  &#92;min&#92;{ R(a) , R(b) &#92;} &#92;leq R(a-b) ' class='latex' /></p>
<p> </em></p></blockquote>
<p> <em>Proof:</em>  We begin with the following observation: if <img src='http://s0.wp.com/latex.php?latex=%7Ba%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a}' title='{a}' class='latex' /> is a non-negative function, and <img src='http://s0.wp.com/latex.php?latex=%7Ba%28x%29%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a(x)=0}' title='{a(x)=0}' class='latex' />, then <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+a%28x%29+%3D+%5C%7B+%5Cbf+0+%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla a(x) = &#92;{ &#92;bf 0 &#92;}}' title='{&#92;nabla a(x) = &#92;{ &#92;bf 0 &#92;}}' class='latex' />, because <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> has to be a local minimum.</p>
<p>
Consider the expression <img src='http://s0.wp.com/latex.php?latex=%7B%7C%7C%5Cnabla+%28a-b%29%7C%7C%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{||&#92;nabla (a-b)||^2}' title='{||&#92;nabla (a-b)||^2}' class='latex' /> occurring in the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' />. We have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%7C%7C%5Cnabla+%28a-b%29%7C%7C%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  ||&#92;nabla (a-b)||^2 ' title='&#92;displaystyle  ||&#92;nabla (a-b)||^2 ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%7C%7C+%5Cnabla+a+-+%5Cnabla+b+%7C%7C%5E2+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = || &#92;nabla a - &#92;nabla b ||^2 ' title='&#92;displaystyle  = || &#92;nabla a - &#92;nabla b ||^2 ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D+%7C%7C+%5Cnabla+a%7C%7C%5E2+%2B+%7C%7C+%5Cnabla+b%7C%7C%5E2+-+2+%5Clangle+%5Cnabla+a%2C%5Cnabla+b+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  = || &#92;nabla a||^2 + || &#92;nabla b||^2 - 2 &#92;langle &#92;nabla a,&#92;nabla b &#92;rangle ' title='&#92;displaystyle  = || &#92;nabla a||^2 + || &#92;nabla b||^2 - 2 &#92;langle &#92;nabla a,&#92;nabla b &#92;rangle ' class='latex' /></p>
<p> But
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Clangle+%5Cnabla+a%2C%5Cnabla+b+%5Crangle+%3D+0+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;langle &#92;nabla a,&#92;nabla b &#92;rangle = 0 ' title='&#92;displaystyle  &#92;langle &#92;nabla a,&#92;nabla b &#92;rangle = 0 ' class='latex' /></p>
<p> because for every <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> at least one of <img src='http://s0.wp.com/latex.php?latex=%7Ba%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a(x)}' title='{a(x)}' class='latex' /> or <img src='http://s0.wp.com/latex.php?latex=%7Bb%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{b(x)}' title='{b(x)}' class='latex' /> is zero, and so at least one of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+a%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla a(x)}' title='{&#92;nabla a(x)}' class='latex' /> or <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+b%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla b(x)}' title='{&#92;nabla b(x)}' class='latex' /> is zero.</p>
<p>
Using this fact, we have that the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' /> is equal to the sum of the numerators of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a)}' title='{R(a)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(b)}' title='{R(b)}' class='latex' />:</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cint_M+%7C%7C%5Cnabla+a-b%7C%7C%5E2+%7B%5Crm+d%7D+%5Cmu+%3D+%5Cint_M+%7C%7C%5Cnabla+a-b%7C%7C%5E2+%7B%5Crm+d%7D+%5Cmu+%2B+%5Cint_M+%7C%7C%5Cnabla+a-b%7C%7C%5E2+%7B%5Crm+d%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} &#92;mu = &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} &#92;mu + &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} ' title='&#92;displaystyle  &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} &#92;mu = &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} &#92;mu + &#92;int_M ||&#92;nabla a-b||^2 {&#92;rm d} ' class='latex' /></p>
<p> and the denominator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' /> is also the sum of the denominators of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a)}' title='{R(a)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(b)}' title='{R(b)}' class='latex' />:
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D%5Cint_M+%28a-b%29%5E2+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  =&#92;int_M (a-b)^2 {&#92;rm d} &#92;mu ' title='&#92;displaystyle  =&#92;int_M (a-b)^2 {&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D%5Cint_M+a%5E2+%7B%5Crm+d%7D+%5Cmu+%2B+%5Cint_M+b%5E2+%7B%5Crm+d%7D+%5Cmu+-+2+%5Cint_M+ab+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  =&#92;int_M a^2 {&#92;rm d} &#92;mu + &#92;int_M b^2 {&#92;rm d} &#92;mu - 2 &#92;int_M ab {&#92;rm d} &#92;mu ' title='&#92;displaystyle  =&#92;int_M a^2 {&#92;rm d} &#92;mu + &#92;int_M b^2 {&#92;rm d} &#92;mu - 2 &#92;int_M ab {&#92;rm d} &#92;mu ' class='latex' /></p>
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%3D%5Cint_M+a%5E2+%7B%5Crm+d%7D+%5Cmu+%2B+%5Cint_M+b%5E2+%7B%5Crm+d%7D+%5Cmu+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  =&#92;int_M a^2 {&#92;rm d} &#92;mu + &#92;int_M b^2 {&#92;rm d} &#92;mu ' title='&#92;displaystyle  =&#92;int_M a^2 {&#92;rm d} &#92;mu + &#92;int_M b^2 {&#92;rm d} &#92;mu ' class='latex' /></p>
<p> because <img src='http://s0.wp.com/latex.php?latex=%7Ba%28x%29b%28x%29%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a(x)b(x)=0}' title='{a(x)b(x)=0}' class='latex' /> for every <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />. The fact now follows from the inequality
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin+%5Cleft+%5C%7B+%5Cfrac+%7Bn_1%7D%7Bd_1%7D+%2C+%5Cfrac%7Bn_2%7D%7Bd_2%7D+%5Cright+%5C%7D+%5Cleq+%5Cfrac%7Bn_1%2Bn_2%7D%7Bd_1%2Bd_2%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min &#92;left &#92;{ &#92;frac {n_1}{d_1} , &#92;frac{n_2}{d_2} &#92;right &#92;} &#92;leq &#92;frac{n_1+n_2}{d_1+d_2} ' title='&#92;displaystyle  &#92;min &#92;left &#92;{ &#92;frac {n_1}{d_1} , &#92;frac{n_2}{d_2} &#92;right &#92;} &#92;leq &#92;frac{n_1+n_2}{d_1+d_2} ' class='latex' /></p>
<p> <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
The lemma now follows by observing that <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+}' title='{f^+}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-}' title='{f^-}' class='latex' /> are non-negative and disjointly supported, so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cmin%5C%7B+R%28f%5E%2B%29+%2C+R%28f%5E-%29+%5C%7D+%5Cleq+R%28%5Cbar+f%29+%5Cleq+R%28f%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;min&#92;{ R(f^+) , R(f^-) &#92;} &#92;leq R(&#92;bar f) &#92;leq R(f) ' title='&#92;displaystyle  &#92;min&#92;{ R(f^+) , R(f^-) &#92;} &#92;leq R(&#92;bar f) &#92;leq R(f) ' class='latex' /></p>
<p> and that both <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E%2B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^+}' title='{f^+}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf%5E-%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f^-}' title='{f^-}' class='latex' /> have a support of volume at most <img src='http://s0.wp.com/latex.php?latex=%7B%5Cfrac+12+%5Cmu%28M%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;frac 12 &#92;mu(M)}' title='{&#92;frac 12 &#92;mu(M)}' class='latex' />. <img src='http://s0.wp.com/latex.php?latex=%5CBox&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;Box' title='&#92;Box' class='latex' /></p>
<p>
If anybody is still reading, it is worth observing a couple of differences between the discrete proof and the continuous proof. </p>
<p>
The <img src='http://s0.wp.com/latex.php?latex=%7B%5Cell_1%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;ell_1}' title='{&#92;ell_1}' class='latex' /> Rayleigh quotient is defined slightly differently in the continuous case. It would correspond to defining it as</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Csum_%7Bu%5Cin+V%7D+%5Csqrt%7B%5Csum_%7Bv%3A+%28u%2Cv%29%5Cin+E%7D+%28f_u-f_v%29%5E2+%7D+%7D%7Bd+%5Csum_v+%7Cf_v%7C%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;sum_{u&#92;in V} &#92;sqrt{&#92;sum_{v: (u,v)&#92;in E} (f_u-f_v)^2 } }{d &#92;sum_v |f_v|} ' title='&#92;displaystyle  &#92;frac {&#92;sum_{u&#92;in V} &#92;sqrt{&#92;sum_{v: (u,v)&#92;in E} (f_u-f_v)^2 } }{d &#92;sum_v |f_v|} ' class='latex' /></p>
<p> in the discrete case.</p>
<p>
If <img src='http://s0.wp.com/latex.php?latex=%7Ba%2Cb+%5Cin+%7B%5Cmathbb+R%7D%5EV%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{a,b &#92;in {&#92;mathbb R}^V}' title='{a,b &#92;in {&#92;mathbb R}^V}' class='latex' /> are disjointly supported and nonnegative, the sum of the numerators of the Rayleigh quotients <img src='http://s0.wp.com/latex.php?latex=%7BR%28a%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a)}' title='{R(a)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(-b)}' title='{R(-b)}' class='latex' /> can be strictly smaller than the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a-b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a-b)}' title='{R(a-b)}' class='latex' />, while we always have equality in the continuous case. In the discrete case, the sum of the numerators of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a)}' title='{R(a)}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7BR%28b%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(b)}' title='{R(b)}' class='latex' /> can be up to twice the numerator of <img src='http://s0.wp.com/latex.php?latex=%7BR%28a%2Bb%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{R(a+b)}' title='{R(a+b)}' class='latex' /> (this fact is useful, but it did not come up in this proof), while again we have exact equality in the continuous case.</p>
<p>
The chain rule calculation
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cnabla+f%5E2+%3D+2f+%5Cnabla+f+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;nabla f^2 = 2f &#92;nabla f ' title='&#92;displaystyle  &#92;nabla f^2 = 2f &#92;nabla f ' class='latex' /></p>
<p> corresponds to the step
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++f_v%5E2+-+f_u%5E2+%3D+%28f_v+%2B+f_u%29+%5Ccdot+%28f_v+-+f_u%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  f_v^2 - f_u^2 = (f_v + f_u) &#92;cdot (f_v - f_u) ' title='&#92;displaystyle  f_v^2 - f_u^2 = (f_v + f_u) &#92;cdot (f_v - f_u) ' class='latex' /></p>
<p> In the continuous case, <img src='http://s0.wp.com/latex.php?latex=%7Bf_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_v}' title='{f_v}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7Bf_u%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_u}' title='{f_u}' class='latex' /> are &#8220;infinitesimally close&#8221;, so we can approximate <img src='http://s0.wp.com/latex.php?latex=%7Bf_v+%2B+f_u%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_v + f_u}' title='{f_v + f_u}' class='latex' /> by <img src='http://s0.wp.com/latex.php?latex=%7B2f_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{2f_v}' title='{2f_v}' class='latex' />.</p>
<p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2650/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2650/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2650&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/03/21/proof-of-the-cheeger-inequality-in-manifolds/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>The Cheeger inequality in manifolds</title>
		<link>http://lucatrevisan.wordpress.com/2013/03/20/the-cheeger-inequality-in-manifolds/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/03/20/the-cheeger-inequality-in-manifolds/#comments</comments>
		<pubDate>Wed, 20 Mar 2013 18:16:28 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[math]]></category>
		<category><![CDATA[theory]]></category>
		<category><![CDATA[Cheeger inequality]]></category>
		<category><![CDATA[Expanders]]></category>
		<category><![CDATA[Laplacian]]></category>
		<category><![CDATA[manifolds]]></category>
		<category><![CDATA[spectral graph theory]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2642</guid>
		<description><![CDATA[Readers of in theory have heard about Cheeger&#8217;s inequality a lot. It is a relation between the edge expansion (or, in graphs that are not regular, the conductance) of a graph and the second smallest eigenvalue of its Laplacian (a normalized version of the adjacency matrix). The inequality gives a worst-case analysis of the &#8220;sweep&#8221; [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2642&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Readers of <em>in theory</em> have heard about Cheeger&#8217;s inequality a lot. It is a relation between the edge expansion (or, in graphs that are not regular, the conductance) of a graph and the second smallest eigenvalue of its Laplacian (a normalized version of the adjacency matrix). The inequality gives a worst-case analysis of the &#8220;sweep&#8221; algorithm for finding sparse cuts, it shows a necessary and sufficient for a graph to be an expander, and it relates the mixing time of a graph to its conductance.</p>
<p>
Readers who have heard this story before will recall that a version of this result for vertex expansion was first proved by Alon and Milman, and the result for edge expansion appeared in a paper of Dodzuik, all from the mid-1980s. The result, however, is not called <em>Cheeger&#8217;s inequality</em> just because of Stigler&#8217;s rule: Cheeger proved in the 1970s a very related result on manifolds, of which the result on graphs is the discrete analog.</p>
<p>
So, what is the <em>actual</em> Cheeger&#8217;s inequality? </p>
<blockquote><p><b>Theorem 1 (Cheeger&#8217;s inequality)</b> <em> Let <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> be an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional smooth, compact, Riemann manifold without boundary with metric <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' />, let <img src='http://s0.wp.com/latex.php?latex=%7BL%3A%3D+-+%7B%5Crm+div%7D+%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L:= - {&#92;rm div} &#92;nabla}' title='{L:= - {&#92;rm div} &#92;nabla}' class='latex' /> be the Laplace-Beltrami operator on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, let <img src='http://s0.wp.com/latex.php?latex=%7B0%3D%5Clambda_1+%5Cleq+%5Clambda_2+%5Cleq+%5Ccdots+%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{0=&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots }' title='{0=&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots }' class='latex' /> be the eigenvalues of <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' />, and define the <em>Cheeger constant</em> of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> to be</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++h%28M%29%3A%3D+%5Cinf_%7BS%5Csubseteq+M+%3A+%5C+0+%3C+%5Cmu%28S%29+%5Cleq+%5Cfrac+12+%5Cmu%28M%29%7D+%5C+%5Cfrac%7B%5Cmu_%7Bn-1%7D%28%5Cpartial%28S%29%29%7D%7B%5Cmu%28S%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  h(M):= &#92;inf_{S&#92;subseteq M : &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(M)} &#92; &#92;frac{&#92;mu_{n-1}(&#92;partial(S))}{&#92;mu(S)} ' title='&#92;displaystyle  h(M):= &#92;inf_{S&#92;subseteq M : &#92; 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(M)} &#92; &#92;frac{&#92;mu_{n-1}(&#92;partial(S))}{&#92;mu(S)} ' class='latex' /></p>
<p>
where the <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial (S)}' title='{&#92;partial (S)}' class='latex' /> is the boundary of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu}' title='{&#92;mu}' class='latex' /> is the <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional measure, and <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu_%7Bn-1%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu_{n-1}}' title='{&#92;mu_{n-1}}' class='latex' /> is <img src='http://s0.wp.com/latex.php?latex=%7B%28n-1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(n-1)}' title='{(n-1)}' class='latex' />-th dimensional measure defined using <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' />. Then</p>
<p>
<a name="cheeger">
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle+++h%28M%29+%5Cleq+2+%5Csqrt%7B%5Clambda_2%7D+%5C+%5C+%5C+%5C+%5C+%281%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle   h(M) &#92;leq 2 &#92;sqrt{&#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (1)' title='&#92;displaystyle   h(M) &#92;leq 2 &#92;sqrt{&#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (1)' class='latex' /></p>
<p></a> </em></p></blockquote>
<p><p>
The purpose of this post is to describe to the reader who knows nothing about differential geometry and who does not remember much multivariate calculus (that is, the reader who is in the position I was in a few weeks ago) what the above statement means, to describe the proof, and to see that it is in fact the <em>same proof</em> as the proof of the statement about graphs.</p>
<p>
In this post we will define the terms appearing in the above theorem, and see their relation with analogous notions in graphs. In the next post we will see the proof.</p>
<p>
<span id="more-2642"></span></p>
<p>
First we recall the definitions in the case of graphs, which are good &#8220;models&#8221; to keep in mind as we will give the definitions of a manifold and of the Laplacian of a manifold.</p>
<p>
Let <img src='http://s0.wp.com/latex.php?latex=%7BG%3D%28V%2CE%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G=(V,E)}' title='{G=(V,E)}' class='latex' /> be a <img src='http://s0.wp.com/latex.php?latex=%7Bd%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{d}' title='{d}' class='latex' />-regular graph and <img src='http://s0.wp.com/latex.php?latex=%7BA%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A}' title='{A}' class='latex' /> be the adjacency matrix of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' />. If <img src='http://s0.wp.com/latex.php?latex=%7BS%5Csubseteq+V%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S&#92;subseteq V}' title='{S&#92;subseteq V}' class='latex' /> is a subset of vertices, its volume <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S)}' title='{&#92;mu(S)}' class='latex' /> is defined as the sum of the degrees of the elements of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29%3A%3D+d%7CS%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S):= d|S|}' title='{&#92;mu(S):= d|S|}' class='latex' />. The boundary <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial (S)}' title='{&#92;partial (S)}' class='latex' /> of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> is the set of edges that have one endpoint in <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> and one endpoint in <img src='http://s0.wp.com/latex.php?latex=%7BV-S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{V-S}' title='{V-S}' class='latex' />; the conductance of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28S%29%3A%3D+%5Cfrac%7B%7C%5Cpartial%28S%29%7C%7D%7B%5Cmu%28S%29%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(S):= &#92;frac{|&#92;partial(S)|}{&#92;mu(S)} ' title='&#92;displaystyle  &#92;phi(S):= &#92;frac{|&#92;partial(S)|}{&#92;mu(S)} ' class='latex' /></p>
<p>
and the conductance of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' /> is defined as</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cphi%28G%29%3A%3D+%5Cmin_%7BS%5Csubseteq+V%3A+0+%3C+%5Cmu%28S%29+%5Cleq+%5Cfrac+12+%5Cmu%28V%29+%7D+%5Cphi%28S%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;phi(G):= &#92;min_{S&#92;subseteq V: 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V) } &#92;phi(S) ' title='&#92;displaystyle  &#92;phi(G):= &#92;min_{S&#92;subseteq V: 0 &lt; &#92;mu(S) &#92;leq &#92;frac 12 &#92;mu(V) } &#92;phi(S) ' class='latex' /></p>
<p>
The Laplacian matrix of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' /> is defined as <img src='http://s0.wp.com/latex.php?latex=%7BL%3A%3D+I+-+%5Cfrac+1d+A%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L:= I - &#92;frac 1d A}' title='{L:= I - &#92;frac 1d A}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7BA%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A}' title='{A}' class='latex' /> is the adjacency matrix of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' />. Since <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> is a symmetric real matrix, all its eigenvalues are real, and, if we call them <img src='http://s0.wp.com/latex.php?latex=%7B%5Clambda_1+%5Cleq+%5Clambda_2+%5Cleq+%5Ccdots+%5Cleq+%5Clambda_n%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_n}' title='{&#92;lambda_1 &#92;leq &#92;lambda_2 &#92;leq &#92;cdots &#92;leq &#92;lambda_n}' class='latex' />, the Cheeger inequality in graphs is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Clambda_2%7D+2+%5Cleq+%5Cphi%28G%29+%5Cleq+%5Csqrt%7B2+%5Clambda_2%7D+%5C+%5C+%5C+%5C+%5C+%282%29&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;lambda_2} 2 &#92;leq &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (2)' title='&#92;displaystyle  &#92;frac {&#92;lambda_2} 2 &#92;leq &#92;phi(G) &#92;leq &#92;sqrt{2 &#92;lambda_2} &#92; &#92; &#92; &#92; &#92; (2)' class='latex' /></p>
<p>
<p><b>1. Manifolds, gradient, and divergence </b></p>
<p> <a name="secman"></a></p>
<p>
<p><b>  1.1. What is a manifold? </b></p>
<p><p>
First let us discuss (non-rigorously) what is a manifold: we can think of an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional manifold as a subset <img src='http://s0.wp.com/latex.php?latex=%7BM+%5Csubseteq+%7B%5Cmathbb+R%7D%5Em%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M &#92;subseteq {&#92;mathbb R}^m}' title='{M &#92;subseteq {&#92;mathbb R}^m}' class='latex' />, for some <img src='http://s0.wp.com/latex.php?latex=%7Bm%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{m}' title='{m}' class='latex' />, such that for every point <img src='http://s0.wp.com/latex.php?latex=%7Bx%5Cin+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x&#92;in M}' title='{x&#92;in M}' class='latex' />, if we look at a small ball around <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, the intersection of the ball with <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> looks like a ball in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' />. For example, consider a two-dimensional sphere in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^2}' title='{{&#92;mathbb R}^2}' class='latex' />: for every point on the sphere, a small neighborhood around it looks like a flat disc.</p>
<p>
The formalization of this notion, which will turn out not to require us to think of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> as a subset of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5Em%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^m}' title='{{&#92;mathbb R}^m}' class='latex' /> is rather technical, and it has quite a lot of pieces. Instead of introducing the rigorous definition piece by piece, and trying to understand what a manifold <em>is</em>, I think it&#8217;s better to start by thinking about what a manifold <em>does</em>, that is, what kind of properties we want from the definition, and what kind of calculations we want the definition to allow, and then the details of the definition is just whatever works to capture these intentions. </p>
<p>
Basically, we would like to be able to do with an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional manifold <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> most of the things we would do with <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' />. We would like to have a distance function <img src='http://s0.wp.com/latex.php?latex=%7Bdist%28x%2Cy%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{dist(x,y)}' title='{dist(x,y)}' class='latex' /> between elements <img src='http://s0.wp.com/latex.php?latex=%7Bx%2Cy+%5Cin+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x,y &#92;in M}' title='{x,y &#92;in M}' class='latex' /> that satisfies the triangle inequality and that is the &#8220;length of the shortest path&#8221; from <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> to <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> in <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, we would like to have a measure <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu}' title='{&#92;mu}' class='latex' />, that gives us the &#8220;volume&#8221; <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28A%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(A)}' title='{&#92;mu(A)}' class='latex' /> of a subset <img src='http://s0.wp.com/latex.php?latex=%7BA%5Csubseteq+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A&#92;subseteq M}' title='{A&#92;subseteq M}' class='latex' />. If we define functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' />, we would like to integrate them, and compute <img src='http://s0.wp.com/latex.php?latex=%7B%5Cint_M+f+%7B%5Crm+d%7D+%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;int_M f {&#92;rm d} &#92;mu}' title='{&#92;int_M f {&#92;rm d} &#92;mu}' class='latex' />, or <img src='http://s0.wp.com/latex.php?latex=%7B%5Cint_A+f+%7B%5Crm+d%7D+%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;int_A f {&#92;rm d} &#92;mu}' title='{&#92;int_A f {&#92;rm d} &#92;mu}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7BA%5Csubseteq+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{A&#92;subseteq M}' title='{A&#92;subseteq M}' class='latex' />. We would also like to have a definition of continuous functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' />, or <img src='http://s0.wp.com/latex.php?latex=%7Bf%3AM+%5Crightarrow+%7B%5Cmathbb+C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f:M &#92;rightarrow {&#92;mathbb C}}' title='{f:M &#92;rightarrow {&#92;mathbb C}}' class='latex' />, or <img src='http://s0.wp.com/latex.php?latex=%7Bf%3AM+%5Crightarrow+%7B%5Cmathbb+R%7D%5Ek%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f:M &#92;rightarrow {&#92;mathbb R}^k}' title='{f:M &#92;rightarrow {&#92;mathbb R}^k}' class='latex' />, and, finally, we would like to define derivatives of functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' />. </p>
<p>
On the other hand, we will not try to think of the elements of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> as vectors, and, in particular, we will not have a definition of adding elements of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, or multiplying them by constants, much less of taking an inner product of them. (This means that the distance function will not come from a norm.) To see why not, consider a 2-dimensional sphere in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5E3%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^3}' title='{{&#92;mathbb R}^3}' class='latex' />. We want to think of it as completely symmetric under rotations, so there can be no meaningful notion of a point on the sphere being &#8220;bigger&#8221; than another, so if <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> is a point on the sphere, there isn&#8217;t a meaningful notion of <img src='http://s0.wp.com/latex.php?latex=%7B2%5Ccdot+x%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{2&#92;cdot x}' title='{2&#92;cdot x}' class='latex' />. (You could try to say <img src='http://s0.wp.com/latex.php?latex=%7B2%5Ccdot+x+%3D+x%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{2&#92;cdot x = x}' title='{2&#92;cdot x = x}' class='latex' />, but then this would imply <img src='http://s0.wp.com/latex.php?latex=%7Bx%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x=0}' title='{x=0}' class='latex' />.)</p>
<p>
Because a manifold is not a vector space, it is tricky to define derivatives. We want to think of an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional manifold as a generalization of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' />, and a function <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A%7B%5Cmathbb+R%7D%5En+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f:{&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' title='{f:{&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' class='latex' /> does not have <em>a</em> derivative. Instead, for every direction <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' />, it has a partial derivative at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> in the direction <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /></p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac%7B%5Cpartial+f%7D%7B%5Cpartial+y%7D+%28x%29+%3D+%5Clim_%7B%5Cepsilon+%5Crightarrow+0%7D+%5Cfrac+%7Bf%28x%2B%5Cepsilon+y%29+-+f%28x%29%7D%7B%5Cepsilon%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac{&#92;partial f}{&#92;partial y} (x) = &#92;lim_{&#92;epsilon &#92;rightarrow 0} &#92;frac {f(x+&#92;epsilon y) - f(x)}{&#92;epsilon} ' title='&#92;displaystyle  &#92;frac{&#92;partial f}{&#92;partial y} (x) = &#92;lim_{&#92;epsilon &#92;rightarrow 0} &#92;frac {f(x+&#92;epsilon y) - f(x)}{&#92;epsilon} ' class='latex' /></p>
<p> and the above expression requires us to add elements of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> and to multiply them by constants.</p>
<p>
However, if we look at a point <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, the immediate neighborhood of <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> does look like a small piece of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' />, which is a vector space. To make this intuition formal, instead of trying to formalize the notion of &#8220;small piece of a vector space,&#8221; one defines directional derivatives where the direction <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> is not in <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> but in the tangent space to <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, which is a honest-to-God vector space.</p>
<p>
In the rigorous definition, we have a topology on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, which allows to talk about &#8220;small intervals around&#8221; a point <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, and to talk about &#8220;continuous functions&#8221; <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+X%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow X}' title='{f: M &#92;rightarrow X}' class='latex' /> where <img src='http://s0.wp.com/latex.php?latex=%7BX%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{X}' title='{X}' class='latex' /> can be <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}}' title='{{&#92;mathbb R}}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb C}}' title='{{&#92;mathbb C}}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5Ek%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^k}' title='{{&#92;mathbb R}^k}' class='latex' />, and so on. Then, for every small interval around a point <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> we have an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional coordinate system, which we can think of as an approximation of the interval around <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> as a piece of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' />; these coordinate systems are called &#8220;charts&#8221; and their collection is called an &#8220;atlas.&#8221; Charts of nearby points are supposed to be &#8220;consistent in their intersection,&#8221; which is assured by consistent mappings between them. For every point <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> we also have an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional vector space, which is the tangent space at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />. There are also mapping that relate the tangent spaces of nearby points. Finally, we have a &#8220;metric,&#8221; that, to make things more confusing, is not a distance function that satisfies the triangle inequality, but is the definition of an <em>inner product between vectors of the tangent spaces</em>. From the metric, it is possible to define a distance function on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> that satisfies the triangle inequality, and a measure <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu}' title='{&#92;mu}' class='latex' />, and from the measure we can define integrals. Taking partial derivatives is still a bit tricky, and we will return to it when we talk about the gradient.</p>
<p>
If <img src='http://s0.wp.com/latex.php?latex=%7BS%5Csubseteq+M%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S&#92;subseteq M}' title='{S&#92;subseteq M}' class='latex' /> is a subset of the manifold, then the boundary <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S}' title='{&#92;partial S}' class='latex' /> of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> is the set of points <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> such that there are arbitrarily small intervals around <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> that contain both elements of <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' /> and elements of <img src='http://s0.wp.com/latex.php?latex=%7BM-S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M-S}' title='{M-S}' class='latex' />. For nice enough <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' />, <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S}' title='{&#92;partial S}' class='latex' /> will be an <img src='http://s0.wp.com/latex.php?latex=%7B%28n-1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(n-1)}' title='{(n-1)}' class='latex' />-dimensional object, so we will have <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29%3D0%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S)=0}' title='{&#92;mu(S)=0}' class='latex' />, but we can use the metric to define an <img src='http://s0.wp.com/latex.php?latex=%7B%28n-1%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(n-1)}' title='{(n-1)}' class='latex' />-dimensional measure <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu_%7Bn-1%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu_{n-1}}' title='{&#92;mu_{n-1}}' class='latex' />.</p>
<p>
So we have a general sense of the definition of the Cheeger constant in manifold. For the analogy to graphs, we should think of the points of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> as <img src='http://s0.wp.com/latex.php?latex=%7BV%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{V}' title='{V}' class='latex' />, of <img src='http://s0.wp.com/latex.php?latex=%7B%5Cmu%28S%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;mu(S)}' title='{&#92;mu(S)}' class='latex' /> as <img src='http://s0.wp.com/latex.php?latex=%7Bd%7CS%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{d|S|}' title='{d|S|}' class='latex' />, of infinitesimally close points <img src='http://s0.wp.com/latex.php?latex=%7Bx%2Cy%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x,y}' title='{x,y}' class='latex' /> as an edge, and of the boundary <img src='http://s0.wp.com/latex.php?latex=%7B%5Cpartial+S%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;partial S}' title='{&#92;partial S}' class='latex' /> of a set as the set of edges leaving <img src='http://s0.wp.com/latex.php?latex=%7BS%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{S}' title='{S}' class='latex' />.</p>
<p>
<p><b>  1.2. What is the Laplacian? </b></p>
<p><p>
Now we have to define the Laplacian. The Laplacian is a linear operator that maps a function <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' /> to a function <img src='http://s0.wp.com/latex.php?latex=%7BLf+%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Lf : M &#92;rightarrow {&#92;mathbb R}}' title='{Lf : M &#92;rightarrow {&#92;mathbb R}}' class='latex' />, and it is defined as
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++Lf+%3A%3D+-+%7B%5Crm+div%7D+%5Cnabla+f+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  Lf := - {&#92;rm div} &#92;nabla f ' title='&#92;displaystyle  Lf := - {&#92;rm div} &#92;nabla f ' class='latex' /></p>
<p> where <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla}' title='{&#92;nabla}' class='latex' /> is the gradient operator and <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Crm+div%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;rm div}}' title='{{&#92;rm div}}' class='latex' /> is the divergence operator. (All the functions that we talk about are infinitely differentiable.)</p>
<p>
To see what these operators are, and what they have to do with the Laplacian of graphs, recall that, in a graph, </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%28Lf%29_v+%3D+f_v+-+%5Cfrac+1d+%5Csum_%7Bw%3A+%28v%2Cw%29%5Cin+E%7D+f_w+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  (Lf)_v = f_v - &#92;frac 1d &#92;sum_{w: (v,w)&#92;in E} f_w ' title='&#92;displaystyle  (Lf)_v = f_v - &#92;frac 1d &#92;sum_{w: (v,w)&#92;in E} f_w ' class='latex' /></p>
<p> the Laplacian of <img src='http://s0.wp.com/latex.php?latex=%7Bf%5Cin+%7B%5Cmathbb+R%7D%5EV%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#92;in {&#92;mathbb R}^V}' title='{f&#92;in {&#92;mathbb R}^V}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' /> is the difference between the value of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' /> and the average value of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> at neighbors of <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' />. Similarly, in a manifold, <img src='http://s0.wp.com/latex.php?latex=%7B%28Lf%29%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(Lf)(x)}' title='{(Lf)(x)}' class='latex' /> measures how much bigger <img src='http://s0.wp.com/latex.php?latex=%7Bf%28y%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f(y)}' title='{f(y)}' class='latex' /> tends to be on average than <img src='http://s0.wp.com/latex.php?latex=%7Bf%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f(x)}' title='{f(x)}' class='latex' /> at a random point <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> close to <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />.</p>
<p>
We will give some intuition about how the definition of the Laplacian in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> matches the intuition from the case of graphs. The generalization from <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> to an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional manifold is quite technical, but the general intuition is similar.</p>
<p>
<p><b>  1.3. The Laplacian in one dimension </b></p>
<p><p>
To see how to formalize this intuition, suppose <img src='http://s0.wp.com/latex.php?latex=%7BM%3D%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M={&#92;mathbb R}}' title='{M={&#92;mathbb R}}' class='latex' /> and so <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+%7B%5Cmathbb+R%7D+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' title='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' class='latex' />. Then, our intuition for the Laplacian of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> is that, for a small <img src='http://s0.wp.com/latex.php?latex=%7B%5Cepsilon%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;epsilon}' title='{&#92;epsilon}' class='latex' />, we should look at
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++f%28x%29+-+%5Cfrac+12+%28f%28x%2B%5Cepsilon%29+%2B+f%28x-%5Cepsilon%29%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  f(x) - &#92;frac 12 (f(x+&#92;epsilon) + f(x-&#92;epsilon)) ' title='&#92;displaystyle  f(x) - &#92;frac 12 (f(x+&#92;epsilon) + f(x-&#92;epsilon)) ' class='latex' /></p>
<p> Qualitatively, this quantity is positive if <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> is concave and negative if <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> is convex, so it seems related to <img src='http://s0.wp.com/latex.php?latex=%7B-f%27%27%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{-f&#039;&#039;(x)}' title='{-f&#039;&#039;(x)}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7Bf%27%27%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f&#039;&#039;}' title='{f&#039;&#039;}' class='latex' /> is the second derivative of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />. Indeed, the Taylor expansion of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> is
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++f%28x%2B%5Cepsilon%29+%5Capprox+f%28x%29+%2B+%5Cepsilon+f%27%28x%29+%2B+%5Cfrac+%7B%5Cepsilon%5E2%7D2+f%27%27%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  f(x+&#92;epsilon) &#92;approx f(x) + &#92;epsilon f&#039;(x) + &#92;frac {&#92;epsilon^2}2 f&#039;&#039;(x) ' title='&#92;displaystyle  f(x+&#92;epsilon) &#92;approx f(x) + &#92;epsilon f&#039;(x) + &#92;frac {&#92;epsilon^2}2 f&#039;&#039;(x) ' class='latex' /></p>
<p> and so
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++f%28x%29+-+%5Cfrac+12+%28f%28x%2B%5Cepsilon%29+%2B+f%28x-%5Cepsilon%29%29+%5Capprox+-%5Cfrac+12+%5Cepsilon%5E2+f%27%27%28x%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  f(x) - &#92;frac 12 (f(x+&#92;epsilon) + f(x-&#92;epsilon)) &#92;approx -&#92;frac 12 &#92;epsilon^2 f&#039;&#039;(x) ' title='&#92;displaystyle  f(x) - &#92;frac 12 (f(x+&#92;epsilon) + f(x-&#92;epsilon)) &#92;approx -&#92;frac 12 &#92;epsilon^2 f&#039;&#039;(x) ' class='latex' /></p>
<p>
And, indeed, for functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+%7B%5Cmathbb+R%7D+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' title='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' class='latex' /> both the gradient operator and the divergence operator are just the derivative operator, and so <img src='http://s0.wp.com/latex.php?latex=%7BLf%28x%29+%3D+-f%27%27%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Lf(x) = -f&#039;&#039;(x)}' title='{Lf(x) = -f&#039;&#039;(x)}' class='latex' /> and we have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++Lf%28x%29+%3D+%5Clim_%7B%5Cepsilon+%5Crightarrow+%5Cinfty%7D+%5Cfrac+1%7B%5Cepsilon%5E2%7D+%5Ccdot+%282f%28x%29+-+f%28x%2B%5Cepsilon%29+-f%28x-%5Cepsilon%29%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  Lf(x) = &#92;lim_{&#92;epsilon &#92;rightarrow &#92;infty} &#92;frac 1{&#92;epsilon^2} &#92;cdot (2f(x) - f(x+&#92;epsilon) -f(x-&#92;epsilon)) ' title='&#92;displaystyle  Lf(x) = &#92;lim_{&#92;epsilon &#92;rightarrow &#92;infty} &#92;frac 1{&#92;epsilon^2} &#92;cdot (2f(x) - f(x+&#92;epsilon) -f(x-&#92;epsilon)) ' class='latex' /></p>
<p> which matches our intuition from the case of graphs.</p>
<p>
For functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+%7B%5Cmathbb+R%7D+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' title='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' class='latex' />, the operator <img src='http://s0.wp.com/latex.php?latex=%7BL%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L}' title='{L}' class='latex' /> is linear, and we may ask if it has eigenvalues and eigenfunctions, that is, if there are numbers <img src='http://s0.wp.com/latex.php?latex=%7B%5Clambda%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;lambda}' title='{&#92;lambda}' class='latex' /> and functions <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> for which the equation
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++Lf+%3D+%5Clambda+f+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  Lf = &#92;lambda f ' title='&#92;displaystyle  Lf = &#92;lambda f ' class='latex' /></p>
<p> holds. Let&#8217;s see: what functions are equal to their second derivative, up to a multiplicative constant? For example, <img src='http://s0.wp.com/latex.php?latex=%7B%5Csin+kx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;sin kx}' title='{&#92;sin kx}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B%5Ccos+kx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;cos kx}' title='{&#92;cos kx}' class='latex' /> are, where <img src='http://s0.wp.com/latex.php?latex=%7Bk%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{k}' title='{k}' class='latex' /> is an integer. (So is <img src='http://s0.wp.com/latex.php?latex=%7Be%5E%7Bkx%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{e^{kx}}' title='{e^{kx}}' class='latex' />.)</p>
<p>
Now suppose that our manifold <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> is a unit circle in the plane, that is, points of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> are of the form <img src='http://s0.wp.com/latex.php?latex=%7B%28%5Csin+x%2C%5Ccos+x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(&#92;sin x,&#92;cos x)}' title='{(&#92;sin x,&#92;cos x)}' class='latex' />. This is a (one-dimensional) manifold because a small arc around a point is quite close to being a straight segment. If <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+%7B%5Cmathbb+R%7D+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' title='{f: {&#92;mathbb R} &#92;rightarrow {&#92;mathbb R}}' class='latex' /> is periodic with period <img src='http://s0.wp.com/latex.php?latex=%7B%5B0%2C2%5Cpi%5D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{[0,2&#92;pi]}' title='{[0,2&#92;pi]}' class='latex' />, we can use it to define a function <img src='http://s0.wp.com/latex.php?latex=%7BF%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{F}' title='{F}' class='latex' /> on <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7BF%28%5Csin+x%2C+%5Ccos+x%29+%3D+f%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{F(&#92;sin x, &#92;cos x) = f(x)}' title='{F(&#92;sin x, &#92;cos x) = f(x)}' class='latex' />; similarly, if <img src='http://s0.wp.com/latex.php?latex=%7BF%3AM+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{F:M &#92;rightarrow {&#92;mathbb R}}' title='{F:M &#92;rightarrow {&#92;mathbb R}}' class='latex' /> is defined on the circle we can think of it as a periodic function <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> with period <img src='http://s0.wp.com/latex.php?latex=%7B%5B0%2C2%5Cpi%5D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{[0,2&#92;pi]}' title='{[0,2&#92;pi]}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7Bf%28x%29+%3D+F%28%5Csin+x%2C%5Ccos+x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f(x) = F(&#92;sin x,&#92;cos x)}' title='{f(x) = F(&#92;sin x,&#92;cos x)}' class='latex' />. In fact, there isn&#8217;t really any difference between thinking of functions defined over <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> and periodic functions of period <img src='http://s0.wp.com/latex.php?latex=%7B%5B0%2C2%5Cpi%5D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{[0,2&#92;pi]}' title='{[0,2&#92;pi]}' class='latex' />, and the Laplacian of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> will be the operator that takes a periodic function to minus its second derivative. So <img src='http://s0.wp.com/latex.php?latex=%7B%5Csin+kx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;sin kx}' title='{&#92;sin kx}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B%5Ccos+kx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;cos kx}' title='{&#92;cos kx}' class='latex' /> will be eigenvectors of the Laplacian of the circle, with eigenvalues <img src='http://s0.wp.com/latex.php?latex=%7B%5Capprox+k%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;approx k^2}' title='{&#92;approx k^2}' class='latex' />. Note the extreme similarity to the spectrum of the circle as a graph, where the eigenvectors are vectors whose <img src='http://s0.wp.com/latex.php?latex=%7Bj%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{j}' title='{j}' class='latex' />-th coordinate is <img src='http://s0.wp.com/latex.php?latex=%7B%5Csin+2%5Cpi+kj%2Fn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;sin 2&#92;pi kj/n}' title='{&#92;sin 2&#92;pi kj/n}' class='latex' /> or <img src='http://s0.wp.com/latex.php?latex=%7B%5Ccos+2%5Cpi+k+j%2Fn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;cos 2&#92;pi k j/n}' title='{&#92;cos 2&#92;pi k j/n}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B2%5Cpi+j%2Fn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{2&#92;pi j/n}' title='{2&#92;pi j/n}' class='latex' /> ranges in <img src='http://s0.wp.com/latex.php?latex=%7B%5B0%2C2%5Cpi%5D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{[0,2&#92;pi]}' title='{[0,2&#92;pi]}' class='latex' />. The main difference is one of normalization: in the circle graph, all eigenvalues are at most 2, at the smallest positive one is about <img src='http://s0.wp.com/latex.php?latex=%7B1%2Fn%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{1/n^2}' title='{1/n^2}' class='latex' />; in the circle manifold the eigenvalues are arbitrarily large, and the smallest positive one is 1. However, if we call <img src='http://s0.wp.com/latex.php?latex=%7B%5Clambda_k%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;lambda_k}' title='{&#92;lambda_k}' class='latex' /> the <img src='http://s0.wp.com/latex.php?latex=%7Bk%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{k}' title='{k}' class='latex' />-th smallest eigenvalue, in both cases we have that <img src='http://s0.wp.com/latex.php?latex=%7B%5Clambda_k%2F%5Clambda_2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;lambda_k/&#92;lambda_2}' title='{&#92;lambda_k/&#92;lambda_2}' class='latex' /> is about <img src='http://s0.wp.com/latex.php?latex=%7Bk%5E2%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{k^2}' title='{k^2}' class='latex' />.</p>
<p>
<p><b>  1.4. The gradient in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> </b></p>
<p><p>
For the higher-dimensional case, let us start from the case <img src='http://s0.wp.com/latex.php?latex=%7BM%3D%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M={&#92;mathbb R}^n}' title='{M={&#92;mathbb R}^n}' class='latex' />. In this case, let us fix the orthonormal basis <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+e%7D_1%2C%5Cldots%2C%7B%5Cbf+e%7D_n%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf e}_1,&#92;ldots,{&#92;bf e}_n}' title='{{&#92;bf e}_1,&#92;ldots,{&#92;bf e}_n}' class='latex' /> for <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> where <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+e%7D_i%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf e}_i}' title='{{&#92;bf e}_i}' class='latex' /> is the vector that has zeroes everywhere except a 1 in the <img src='http://s0.wp.com/latex.php?latex=%7Bi%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{i}' title='{i}' class='latex' />-th position. For a function <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+%7B%5Cmathbb+R%7D%5En+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' title='{f: {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' class='latex' />, its gradient <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f}' title='{&#92;nabla f}' class='latex' /> is a function that maps a point <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' /> to an <img src='http://s0.wp.com/latex.php?latex=%7Bn%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{n}' title='{n}' class='latex' />-dimensional vector, which contains the partial derivatives of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />, that is</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cnabla+f+%28%7B%5Cbf+x%7D%29+%3D+%5Cleft%28+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+e%7D_1%7D%28%7B%5Cbf+x%7D%29%2C%5Cldots%2C%5Cfrac%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+e%7D_n%7D%28%7B%5Cbf+x%7D%29%5Cright%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;nabla f ({&#92;bf x}) = &#92;left( &#92;frac {&#92;partial f}{&#92;partial {&#92;bf e}_1}({&#92;bf x}),&#92;ldots,&#92;frac{&#92;partial f}{&#92;partial {&#92;bf e}_n}({&#92;bf x})&#92;right) ' title='&#92;displaystyle  &#92;nabla f ({&#92;bf x}) = &#92;left( &#92;frac {&#92;partial f}{&#92;partial {&#92;bf e}_1}({&#92;bf x}),&#92;ldots,&#92;frac{&#92;partial f}{&#92;partial {&#92;bf e}_n}({&#92;bf x})&#92;right) ' class='latex' /></p>
<p>
where, for a vector <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' />, the partial derivative <img src='http://s0.wp.com/latex.php?latex=%7B%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} }' title='{&#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} }' class='latex' /> is the function</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29+%3D+%5Clim_%7B%5Cepsilon+%5Crightarrow+0%7D+%5Cfrac%7Bf%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29+-+f%28%7B%5Cbf+x%7D%29%7D%7B%5Cepsilon%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;lim_{&#92;epsilon &#92;rightarrow 0} &#92;frac{f({&#92;bf x}+&#92;epsilon {&#92;bf y}) - f({&#92;bf x})}{&#92;epsilon} ' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;lim_{&#92;epsilon &#92;rightarrow 0} &#92;frac{f({&#92;bf x}+&#92;epsilon {&#92;bf y}) - f({&#92;bf x})}{&#92;epsilon} ' class='latex' /></p>
<p>
If <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+z%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf z}}' title='{{&#92;bf z}}' class='latex' /> are orthogonal then</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%2B%7B%5Cbf+z%7D%7D+%28x%29+%3D+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29+%2B+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+z%7D%7D+%28%7B%5Cbf+x%7D%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}+{&#92;bf z}} (x) = &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) + &#92;frac {&#92;partial f}{&#92;partial {&#92;bf z}} ({&#92;bf x}) ' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}+{&#92;bf z}} (x) = &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) + &#92;frac {&#92;partial f}{&#92;partial {&#92;bf z}} ({&#92;bf x}) ' class='latex' /></p>
<p> this means that for every vector <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%3D%28y_1%2C%5Cldots%2Cy_n%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}=(y_1,&#92;ldots,y_n)}' title='{{&#92;bf y}=(y_1,&#92;ldots,y_n)}' class='latex' /> we have</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29+%3D+%5Csum_i+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+e%7D_i%7D+%28%7B%5Cbf+x%7D%29+%5Ccdot+y_i+%3D+%5Clangle+%5Cnabla+f%28%7B%5Cbf+x%7D%29%2C+%7B%5Cbf+y%7D%5Crangle&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;sum_i &#92;frac {&#92;partial f}{&#92;partial {&#92;bf e}_i} ({&#92;bf x}) &#92;cdot y_i = &#92;langle &#92;nabla f({&#92;bf x}), {&#92;bf y}&#92;rangle' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;sum_i &#92;frac {&#92;partial f}{&#92;partial {&#92;bf e}_i} ({&#92;bf x}) &#92;cdot y_i = &#92;langle &#92;nabla f({&#92;bf x}), {&#92;bf y}&#92;rangle' class='latex' /></p>
<p>
It is important to note that there was nothing special about the use of the base <img src='http://s0.wp.com/latex.php?latex=%7B%5C%7B+%7B%5Cbf+e%7D_1%2C%5Cldots%2C%7B%5Cbf+e%7D_n%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;{ {&#92;bf e}_1,&#92;ldots,{&#92;bf e}_n&#92;}}' title='{&#92;{ {&#92;bf e}_1,&#92;ldots,{&#92;bf e}_n&#92;}}' class='latex' />. Take an arbitrary orthonormal base <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Ccal+B%7D+%3A%3D+%5C%7B+%7B%5Cbf+b%7D_1%2C%5Cldots%2C%7B%5Cbf+b%7D_n+%5C%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;cal B} := &#92;{ {&#92;bf b}_1,&#92;ldots,{&#92;bf b}_n &#92;}}' title='{{&#92;cal B} := &#92;{ {&#92;bf b}_1,&#92;ldots,{&#92;bf b}_n &#92;}}' class='latex' />, then define the &#8220;base-<img src='http://s0.wp.com/latex.php?latex=%7B%5Ccal+B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;cal B}' title='{&#92;cal B}' class='latex' />&#8221; gradient as</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cnabla_%7B%5Ccal+B%7D+f%28%7B%5Cbf+x%7D%29%3A%3D+%5Csum_i+%5Cfrac%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+b%7D_i%7D%28%7B%5Cbf+x%7D%29+%5Ccdot+%7B%5Cbf+b%7D_i+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;nabla_{&#92;cal B} f({&#92;bf x}):= &#92;sum_i &#92;frac{&#92;partial f}{&#92;partial {&#92;bf b}_i}({&#92;bf x}) &#92;cdot {&#92;bf b}_i ' title='&#92;displaystyle  &#92;nabla_{&#92;cal B} f({&#92;bf x}):= &#92;sum_i &#92;frac{&#92;partial f}{&#92;partial {&#92;bf b}_i}({&#92;bf x}) &#92;cdot {&#92;bf b}_i ' class='latex' /></p>
<p> then we again have that for every <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' />, after writing <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D+%3D+%5Csum_i+%5Clangle+%7B%5Cbf+y%7D%2C%7B%5Cbf+b%7D_i%5Crangle+%5Ccdot+%7B%5Cbf+b%7D_i%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y} = &#92;sum_i &#92;langle {&#92;bf y},{&#92;bf b}_i&#92;rangle &#92;cdot {&#92;bf b}_i}' title='{{&#92;bf y} = &#92;sum_i &#92;langle {&#92;bf y},{&#92;bf b}_i&#92;rangle &#92;cdot {&#92;bf b}_i}' class='latex' />,</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29+%3D+%5Csum_i+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+b%7D_i%7D+%28%7B%5Cbf+x%7D%29+%5Clangle+%7B%5Cbf+y%7D%2C%7B%5Cbf+b%7D_i%5Crangle+%3D+%5Clangle+%5Cnabla_%7B%5Ccal+B%7D+f%28%7B%5Cbf+x%7D%29+%2C%7B%5Cbf+y%7D+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;sum_i &#92;frac {&#92;partial f}{&#92;partial {&#92;bf b}_i} ({&#92;bf x}) &#92;langle {&#92;bf y},{&#92;bf b}_i&#92;rangle = &#92;langle &#92;nabla_{&#92;cal B} f({&#92;bf x}) ,{&#92;bf y} &#92;rangle ' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;sum_i &#92;frac {&#92;partial f}{&#92;partial {&#92;bf b}_i} ({&#92;bf x}) &#92;langle {&#92;bf y},{&#92;bf b}_i&#92;rangle = &#92;langle &#92;nabla_{&#92;cal B} f({&#92;bf x}) ,{&#92;bf y} &#92;rangle ' class='latex' /></p>
<p> so, in fact, <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla_%7B%5Ccal+B%7D+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla_{&#92;cal B} f({&#92;bf x})}' title='{&#92;nabla_{&#92;cal B} f({&#92;bf x})}' class='latex' /> is always the same vector <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f({&#92;bf x})}' title='{&#92;nabla f({&#92;bf x})}' class='latex' /> regardless of the choice of <img src='http://s0.wp.com/latex.php?latex=%7B%5Ccal+B%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;cal B}' title='{&#92;cal B}' class='latex' />.</p>
<p>
Indeed, we could take as the <em>definition</em> of the gradient to say that <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f({&#92;bf x})}' title='{&#92;nabla f({&#92;bf x})}' class='latex' /> is the unique vector that satisfies the equation</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29+%3D+%5Clangle+%5Cnabla+f%28%7B%5Cbf+x%7D%29%2C+%7B%5Cbf+y%7D+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;langle &#92;nabla f({&#92;bf x}), {&#92;bf y} &#92;rangle ' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}) = &#92;langle &#92;nabla f({&#92;bf x}), {&#92;bf y} &#92;rangle ' class='latex' /></p>
<p> for every <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' />.</p>
<p>
It is also worth nothing that, among all unit vectors <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' />, the one that maximizes <img src='http://s0.wp.com/latex.php?latex=%7B%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x})}' title='{&#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x})}' class='latex' /> is the one parallel to <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f({&#92;bf x})}' title='{&#92;nabla f({&#92;bf x})}' class='latex' />, so <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f({&#92;bf x})}' title='{&#92;nabla f({&#92;bf x})}' class='latex' /> points in the direction in which <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> grows the most near <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' />, which is the most intuitive interpretation.</p>
<p>
If <img src='http://s0.wp.com/latex.php?latex=%7Bf%3A+M+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f: M &#92;rightarrow {&#92;mathbb R}}' title='{f: M &#92;rightarrow {&#92;mathbb R}}' class='latex' /> in general, then <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f(x)}' title='{&#92;nabla f(x)}' class='latex' /> is a vector in the tangent space of <img src='http://s0.wp.com/latex.php?latex=%7BM%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M}' title='{M}' class='latex' /> at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, and the directional derivative <img src='http://s0.wp.com/latex.php?latex=%7B%5Cfrac%7B%5Cpartial+f%7D%7B%5Cpartial+y%7D%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;frac{&#92;partial f}{&#92;partial y}(x)}' title='{&#92;frac{&#92;partial f}{&#92;partial y}(x)}' class='latex' />, where <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> is a vector in the tangent space at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, satisfies
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac%7B%5Cpartial+f%7D%7B%5Cpartial+y%7D%28x%29+%3D+%5Clangle+%5Cnabla+f%28x%29%2C+y+%5Crangle+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac{&#92;partial f}{&#92;partial y}(x) = &#92;langle &#92;nabla f(x), y &#92;rangle ' title='&#92;displaystyle  &#92;frac{&#92;partial f}{&#92;partial y}(x) = &#92;langle &#92;nabla f(x), y &#92;rangle ' class='latex' /></p>
<p> where the inner product is in the tangent space. The definition of partial derivative, and the fact that there is a vector <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla+f%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla f(x)}' title='{&#92;nabla f(x)}' class='latex' /> that satisfies the above equation for every <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> is beyond the scope of these notes.</p>
<p>
<p><b>  1.5. The divergence in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> </b></p>
<p><p>
The definition of divergence is a bit more tricky. If <img src='http://s0.wp.com/latex.php?latex=%7BM+%3D%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{M ={&#92;mathbb R}^n}' title='{M ={&#92;mathbb R}^n}' class='latex' />, then <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Crm+div%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;rm div}}' title='{{&#92;rm div}}' class='latex' /> takes in input a function <img src='http://s0.wp.com/latex.php?latex=%7Bg%3A+%7B%5Cmathbb+R%7D%5En+%5Crightarrow+%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g: {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}^n}' title='{g: {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}^n}' class='latex' />, and returns a function <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Crm+div%7D+g+%3A+%7B%5Cmathbb+R%7D%5En+%5Crightarrow+%7B%5Cmathbb+R%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;rm div} g : {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' title='{{&#92;rm div} g : {&#92;mathbb R}^n &#92;rightarrow {&#92;mathbb R}}' class='latex' />. The definition of <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Crm+div%7D+g%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;rm div} g({&#92;bf x})}' title='{{&#92;rm div} g({&#92;bf x})}' class='latex' />, (up to scaling) can be thought of as follows: consider a small sphere of radius <img src='http://s0.wp.com/latex.php?latex=%7B%5Cepsilon%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;epsilon}' title='{&#92;epsilon}' class='latex' /> around <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' />, pick a random element of the sphere by picking a random unit vector <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' /> and considering the vector <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}+&#92;epsilon {&#92;bf y}}' title='{{&#92;bf x}+&#92;epsilon {&#92;bf y}}' class='latex' />, and then look at the average value of
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle+%5Cfrac+1+%5Cepsilon+%5Clangle+g%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29%2C+%7B%5Cbf+y%7D%5Crangle&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle &#92;frac 1 &#92;epsilon &#92;langle g({&#92;bf x}+&#92;epsilon {&#92;bf y}), {&#92;bf y}&#92;rangle' title='&#92;displaystyle &#92;frac 1 &#92;epsilon &#92;langle g({&#92;bf x}+&#92;epsilon {&#92;bf y}), {&#92;bf y}&#92;rangle' class='latex' /></p>
<p> which is the component of <img src='http://s0.wp.com/latex.php?latex=%7Bg%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g({&#92;bf x}+&#92;epsilon {&#92;bf y})}' title='{g({&#92;bf x}+&#92;epsilon {&#92;bf y})}' class='latex' /> that &#8220;points away&#8221; from <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' /> in the direction of the line that joins <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' /> to <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D+%2B+%5Cepsilon+%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x} + &#92;epsilon {&#92;bf y}}' title='{{&#92;bf x} + &#92;epsilon {&#92;bf y}}' class='latex' />.</p>
<p>
This will be positive if the vector <img src='http://s0.wp.com/latex.php?latex=%7Bg%28%7B%5Cbf+y%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g({&#92;bf y})}' title='{g({&#92;bf y})}' class='latex' /> tends to point away from <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' />, for random <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+y%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf y}}' title='{{&#92;bf y}}' class='latex' /> close to <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cbf+x%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;bf x}}' title='{{&#92;bf x}}' class='latex' />, and negative otherwise.</p>
<p>
<p><b>  1.6. The Laplacian in <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Cmathbb+R%7D%5En%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;mathbb R}^n}' title='{{&#92;mathbb R}^n}' class='latex' /> </b></p>
<p><p>
Now let us see what happens when we instantiate this definition to <img src='http://s0.wp.com/latex.php?latex=%7Bg%28%7B%5Cbf+x%7D%29+%3D+%5Cnabla+f%28%7B%5Cbf+x%7D%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g({&#92;bf x}) = &#92;nabla f({&#92;bf x})}' title='{g({&#92;bf x}) = &#92;nabla f({&#92;bf x})}' class='latex' />. We pick a random unit vector <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' />, and we compute</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+1%5Cepsilon+%5Clangle+%5Cnabla+f%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29%2C+%7B%5Cbf+y%7D+%5Crangle+%3D+%5Cfrac+1+%5Cepsilon+%5Ccdot+%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac 1&#92;epsilon &#92;langle &#92;nabla f({&#92;bf x}+&#92;epsilon {&#92;bf y}), {&#92;bf y} &#92;rangle = &#92;frac 1 &#92;epsilon &#92;cdot &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}+&#92;epsilon {&#92;bf y}) ' title='&#92;displaystyle  &#92;frac 1&#92;epsilon &#92;langle &#92;nabla f({&#92;bf x}+&#92;epsilon {&#92;bf y}), {&#92;bf y} &#92;rangle = &#92;frac 1 &#92;epsilon &#92;cdot &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}+&#92;epsilon {&#92;bf y}) ' class='latex' /></p>
<p> For small <img src='http://s0.wp.com/latex.php?latex=%7B%5Cepsilon%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;epsilon}' title='{&#92;epsilon}' class='latex' />, </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%5Cfrac+%7B%5Cpartial+f%7D%7B%5Cpartial+%7B%5Cbf+y%7D%7D+%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29+%5Capprox+%5Cfrac%7B+f%28%7B%5Cbf+x%7D%2B+2%5Cepsilon+%7B%5Cbf+y%7D%29+-+f%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29+%7D%7B%5Cepsilon%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}+&#92;epsilon {&#92;bf y}) &#92;approx &#92;frac{ f({&#92;bf x}+ 2&#92;epsilon {&#92;bf y}) - f({&#92;bf x}+&#92;epsilon {&#92;bf y}) }{&#92;epsilon} ' title='&#92;displaystyle  &#92;frac {&#92;partial f}{&#92;partial {&#92;bf y}} ({&#92;bf x}+&#92;epsilon {&#92;bf y}) &#92;approx &#92;frac{ f({&#92;bf x}+ 2&#92;epsilon {&#92;bf y}) - f({&#92;bf x}+&#92;epsilon {&#92;bf y}) }{&#92;epsilon} ' class='latex' /></p>
<p>
so</p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++%7B%5Crm+div%7D+%5Cnabla+f%28%7B%5Cbf+x%7D%29+%5Capprox+%5Cfrac+1+%7B%5Cepsilon%5E2%7D+%5Cmathop%7B%5Cmathbb+E%7D_%7B%7B%5Cbf+y%7D+%5Cin+S_%7Bn-1%7D%7D+f%28%7B%5Cbf+x%7D%2B2%5Cepsilon+%7B%5Cbf+y%7D%29+-+f%28%7B%5Cbf+x%7D%2B%5Cepsilon+%7B%5Cbf+y%7D%29+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  {&#92;rm div} &#92;nabla f({&#92;bf x}) &#92;approx &#92;frac 1 {&#92;epsilon^2} &#92;mathop{&#92;mathbb E}_{{&#92;bf y} &#92;in S_{n-1}} f({&#92;bf x}+2&#92;epsilon {&#92;bf y}) - f({&#92;bf x}+&#92;epsilon {&#92;bf y}) ' title='&#92;displaystyle  {&#92;rm div} &#92;nabla f({&#92;bf x}) &#92;approx &#92;frac 1 {&#92;epsilon^2} &#92;mathop{&#92;mathbb E}_{{&#92;bf y} &#92;in S_{n-1}} f({&#92;bf x}+2&#92;epsilon {&#92;bf y}) - f({&#92;bf x}+&#92;epsilon {&#92;bf y}) ' class='latex' /></p>
<p>
which is the average rate of growth of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> in a random direction. So we have that <img src='http://s0.wp.com/latex.php?latex=%7BLf+%3D+-+%7B%5Crm+div%7D+%5Cnabla+f%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Lf = - {&#92;rm div} &#92;nabla f}' title='{Lf = - {&#92;rm div} &#92;nabla f}' class='latex' /> is the rate of decrease of <img src='http://s0.wp.com/latex.php?latex=%7Bf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f}' title='{f}' class='latex' /> in a random direction. This is roughly the equivalent of the discrete case where <img src='http://s0.wp.com/latex.php?latex=%7BLf_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Lf_v}' title='{Lf_v}' class='latex' /> is the difference between <img src='http://s0.wp.com/latex.php?latex=%7Bf_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_v}' title='{f_v}' class='latex' /> and the average value of <img src='http://s0.wp.com/latex.php?latex=%7Bf_w%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_w}' title='{f_w}' class='latex' /> for a random neighbor <img src='http://s0.wp.com/latex.php?latex=%7Bw%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{w}' title='{w}' class='latex' /> of <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' />.</p>
<p>
It turns out that we can also make the correspondence between the discrete and the continuous case closer, by finding linear operators in the discrete case whose composition gives the Laplacian, and that are somewhat analogous to <img src='http://s0.wp.com/latex.php?latex=%7B%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{&#92;nabla}' title='{&#92;nabla}' class='latex' /> and <img src='http://s0.wp.com/latex.php?latex=%7B-+%7B%5Crm+div%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{- {&#92;rm div}}' title='{- {&#92;rm div}}' class='latex' />.</p>
<p>
Consider the <img src='http://s0.wp.com/latex.php?latex=%7B%7CE%7C+%5Ctimes+n%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|E| &#92;times n}' title='{|E| &#92;times n}' class='latex' /> incidence matrix <img src='http://s0.wp.com/latex.php?latex=%7BC%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{C}' title='{C}' class='latex' /> of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' /> defined as follows:
<p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++C_%7Buv%2Cw%7D+%3D+%5Cleft%5C%7B+%5Cbegin%7Barray%7D%7Bcl%7D+1+%26+%5Cmbox%7B+if+%7D+%28u%2Cv%29%5Cin+E+%5Cwedge+u%3Dw%5C%5C+-1+%26+%5Cmbox%7B+if+%7D+%28u%2Cv%29%5Cin+E+%5Cwedge+v%3Dw%5C%5C+0+%26+%5Cmbox%7B+otherwise%7D+%5Cend%7Barray%7D+%5Cright.+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  C_{uv,w} = &#92;left&#92;{ &#92;begin{array}{cl} 1 &amp; &#92;mbox{ if } (u,v)&#92;in E &#92;wedge u=w&#92;&#92; -1 &amp; &#92;mbox{ if } (u,v)&#92;in E &#92;wedge v=w&#92;&#92; 0 &amp; &#92;mbox{ otherwise} &#92;end{array} &#92;right. ' title='&#92;displaystyle  C_{uv,w} = &#92;left&#92;{ &#92;begin{array}{cl} 1 &amp; &#92;mbox{ if } (u,v)&#92;in E &#92;wedge u=w&#92;&#92; -1 &amp; &#92;mbox{ if } (u,v)&#92;in E &#92;wedge v=w&#92;&#92; 0 &amp; &#92;mbox{ otherwise} &#92;end{array} &#92;right. ' class='latex' /></p>
<p> where we have fixed an arbitrary orientation of the edges of <img src='http://s0.wp.com/latex.php?latex=%7BE%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{E}' title='{E}' class='latex' />. Then <img src='http://s0.wp.com/latex.php?latex=%7BCf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Cf}' title='{Cf}' class='latex' /> is an <img src='http://s0.wp.com/latex.php?latex=%7B%7CE%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|E|}' title='{|E|}' class='latex' />-dimensional vector such that <img src='http://s0.wp.com/latex.php?latex=%7BCf_%7Buv%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Cf_{uv}}' title='{Cf_{uv}}' class='latex' /> equals <img src='http://s0.wp.com/latex.php?latex=%7Bf_u-f_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_u-f_v}' title='{f_u-f_v}' class='latex' /> for every (directed) edge <img src='http://s0.wp.com/latex.php?latex=%7B%28u%2Cv%29+%5Cin+E%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(u,v) &#92;in E}' title='{(u,v) &#92;in E}' class='latex' />. We can also think of <img src='http://s0.wp.com/latex.php?latex=%7BCf%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Cf}' title='{Cf}' class='latex' /> as mapping a vertex <img src='http://s0.wp.com/latex.php?latex=%7Bu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{u}' title='{u}' class='latex' /> to a <img src='http://s0.wp.com/latex.php?latex=%7Bdegree%28u%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{degree(u)}' title='{degree(u)}' class='latex' />-dimensional vector <img src='http://s0.wp.com/latex.php?latex=%7BCf_%7Bu%2C%2A%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Cf_{u,*}}' title='{Cf_{u,*}}' class='latex' />, whose <img src='http://s0.wp.com/latex.php?latex=%7Bi%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{i}' title='{i}' class='latex' />-th coordinate is <img src='http://s0.wp.com/latex.php?latex=%7Bf_u+-+f_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_u - f_v}' title='{f_u - f_v}' class='latex' /> where <img src='http://s0.wp.com/latex.php?latex=%7B%28u%2Cv%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{(u,v)}' title='{(u,v)}' class='latex' /> is the <img src='http://s0.wp.com/latex.php?latex=%7Bi%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{i}' title='{i}' class='latex' />-th outgoing edge from <img src='http://s0.wp.com/latex.php?latex=%7Bu%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{u}' title='{u}' class='latex' />. In this view, <img src='http://s0.wp.com/latex.php?latex=%7BC%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{C}' title='{C}' class='latex' /> acts somewhat like the <img src='http://s0.wp.com/latex.php?latex=%7B-+%5Cnabla%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{- &#92;nabla}' title='{- &#92;nabla}' class='latex' />, giving us all the &#8220;derivatives&#8221; of <img src='http://s0.wp.com/latex.php?latex=%7Bf_u%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_u}' title='{f_u}' class='latex' /> in all directions. (The minus sign is because in the derivative at <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' /> we consider <img src='http://s0.wp.com/latex.php?latex=%7Bf%28y%29-f%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f(y)-f(x)}' title='{f(y)-f(x)}' class='latex' /> where <img src='http://s0.wp.com/latex.php?latex=%7By%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{y}' title='{y}' class='latex' /> is close to <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />, but <img src='http://s0.wp.com/latex.php?latex=%7BCf_%7Bu%2C%2A%7D%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{Cf_{u,*}}' title='{Cf_{u,*}}' class='latex' /> &#8220;at <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' />&#8221; gives us <img src='http://s0.wp.com/latex.php?latex=%7Bf_u-f_v%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{f_u-f_v}' title='{f_u-f_v}' class='latex' />.) </p>
<p>
If <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' /> is an <img src='http://s0.wp.com/latex.php?latex=%7B%7CE%7C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{|E|}' title='{|E|}' class='latex' />-dimensional vector, then </p>
<p><p align="center"><img src='http://s0.wp.com/latex.php?latex=%5Cdisplaystyle++C%5ET+g_v+%3D+%5Csum_%7Bw%3A+%28v%2Cw%29%5Cin+E%7D+g_%7Bv%2Cw%7D+-+%5Csum_%7Bu%3A+%28u%2Cv%29+%5Cin+E%7D+g_%7Bu%2Cv%7D+&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='&#92;displaystyle  C^T g_v = &#92;sum_{w: (v,w)&#92;in E} g_{v,w} - &#92;sum_{u: (u,v) &#92;in E} g_{u,v} ' title='&#92;displaystyle  C^T g_v = &#92;sum_{w: (v,w)&#92;in E} g_{v,w} - &#92;sum_{u: (u,v) &#92;in E} g_{u,v} ' class='latex' /></p>
<p> is the flow through <img src='http://s0.wp.com/latex.php?latex=%7Bv%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{v}' title='{v}' class='latex' />, if we think of <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' /> as defining a flow on the (directed) edges of <img src='http://s0.wp.com/latex.php?latex=%7BG%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{G}' title='{G}' class='latex' />. This is the analog of the divergence <img src='http://s0.wp.com/latex.php?latex=%7B%7B%5Crm+div%7D+g%28x%29%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{{&#92;rm div} g(x)}' title='{{&#92;rm div} g(x)}' class='latex' />, which also computes the net flow of <img src='http://s0.wp.com/latex.php?latex=%7Bg%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{g}' title='{g}' class='latex' /> away from a point <img src='http://s0.wp.com/latex.php?latex=%7Bx%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{x}' title='{x}' class='latex' />.</p>
<p>
The reader can verify that we indeed have <img src='http://s0.wp.com/latex.php?latex=%7BL%3D+C%5ET+C%7D&amp;bg=ffffff&amp;fg=000000&amp;s=0' alt='{L= C^T C}' title='{L= C^T C}' class='latex' />. </p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2642/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2642/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2642&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/03/20/the-cheeger-inequality-in-manifolds/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>Habemus Bravium Turing</title>
		<link>http://lucatrevisan.wordpress.com/2013/03/13/habemus-bravium-turing/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/03/13/habemus-bravium-turing/#comments</comments>
		<pubDate>Wed, 13 Mar 2013 23:22:38 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[theory]]></category>
		<category><![CDATA[Shafi Goldwasser]]></category>
		<category><![CDATA[Silvio Micali]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2631</guid>
		<description><![CDATA[The foundations of cryptography were laid down in 1982, the annus mirabilis that saw the publications of the work of Blum and Micali on pseudorandom generators, of Goldwasser and Micali on rigorous definitions of encryption, and of Yao, who gave a more general definitional approach. The paper of Shafi Goldwasser and Silvio Micali, in particular, [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2631&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>The foundations of cryptography were laid down in 1982, the annus mirabilis that saw the publications of the work of Blum and Micali on pseudorandom generators, of Goldwasser and Micali on rigorous definitions of encryption, and of Yao, who gave a more general definitional approach. The paper of Shafi Goldwasser and Silvio Micali, in particular, introduced the incredibly influential concept of <i>indistinguishability</i> of distributions, and the idea of defining security in terms of <i>simulation of an ideal model</i> in which the security requirements are self-evident. (For example, because in the ideal model an adversary is not able to access the channel that we use to send encrypted data.) Almost every definition of security in cryptography follows the simulation approach, which also guides proofs of security. Shafi and Silvio both went on to do foundational work in cryptography, complexity theory, and algorithms, including their work on zero knowledge, secure multiparty computation, and property testing.</p>
<p>So it was with much joy, this early morning in Japan, that I heard the news that Shafi Goldwasser and Silvio Micali have been named as recipients of this year&#8217;s <a href="http://www.acm.org/press-room/news-releases/2013/turing-award-12">Turing award</a>.</p>
<p>Omer Reingold <a href="http://windowsontheory.org/2013/03/13/2012-turing-to-goldwasser-and-micali/" />has more information</a> about their work. With no offense to colleagues around my age and younger, Shafi and Silvio are also representative of a time when leading theoretical computer scientists were more <i>interesting</i> people. They both have incredible charisma.</p>
<p>My favorite memory of Shafi and Silvio is from the time I interviewed for a faculty job at MIT. Shafi was in the last weeks of her pregnancy and did not make an appointment to see me, but then the day of my interview she changed her mind and showed up in Silvio&#8217;s office halfway through my meeting with him.</p>
<p>Silvio had been looking at my schedule and was giving me advice on how to talk to various people. Shafi asked what we were talking about, and then proceeded to give the opposite advice that Silvio had been giving me. The two of them spent the rest of the meeting arguing with each other.</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2631/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2631/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2631&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/03/13/habemus-bravium-turing/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>Hello, and Welcome to Fun with Expanders</title>
		<link>http://lucatrevisan.wordpress.com/2013/03/08/hello-and-welcome-to-fun-with-expanders/</link>
		<comments>http://lucatrevisan.wordpress.com/2013/03/08/hello-and-welcome-to-fun-with-expanders/#comments</comments>
		<pubDate>Fri, 08 Mar 2013 18:32:50 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[CS366]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[theory]]></category>
		<category><![CDATA[ExpanderCourse]]></category>
		<category><![CDATA[Expanders]]></category>
		<category><![CDATA[random walks]]></category>
		<category><![CDATA[spectral graph theory]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2624</guid>
		<description><![CDATA[Long in the planning, my online course on graph partitioning algorithms, expanders, and random walks, will start next month. The course page is up for people to sign up. A friend of mine has compared my camera presence to Sheldon Cooper&#8217;s in &#8220;Fun with Flags,&#8221; which is sadly apt, but hopefully the material will speak [&#8230;]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2624&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Long <a href="http://lucatrevisan.wordpress.com/2012/08/08/the-long-tail-of-online-education/">in the planning</a>, my online course on graph partitioning algorithms, expanders, and random walks, will start next month.</p>
<p>The <a href="http://venture-lab.stanford.edu/expanders">course page</a> is up for people to sign up. A friend of mine has compared my camera presence to Sheldon Cooper&#8217;s in &#8220;Fun with Flags,&#8221; which is sadly apt, but hopefully the material will speak for itself.</p>
<p>Meanwhile, I will be posting about some material that I have finally understood for the first time: the analysis of the Arora-Rao-Vazirani approximation algorithm, the Cheeger inequality in manifolds, and the use of the Selberg &#8220;3/16 theorem&#8221; to analyze expander constructions.</p>
<p>If you are not a fan of recorded performances, there will be a live show in Princeton at the end of June.</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2624/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2624/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2624&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2013/03/08/hello-and-welcome-to-fun-with-expanders/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>
	</item>
		<item>
		<title>This helps a lot</title>
		<link>http://lucatrevisan.wordpress.com/2012/11/14/this-helps-a-lot/</link>
		<comments>http://lucatrevisan.wordpress.com/2012/11/14/this-helps-a-lot/#comments</comments>
		<pubDate>Wed, 14 Nov 2012 22:45:50 +0000</pubDate>
		<dc:creator>luca</dc:creator>
				<category><![CDATA[diversions]]></category>
		<category><![CDATA[politics]]></category>
		<category><![CDATA[David Petraeus]]></category>
		<category><![CDATA[Jill Kelley]]></category>
		<category><![CDATA[John Allen]]></category>
		<category><![CDATA[Nathalie Khavan]]></category>
		<category><![CDATA[Paula Broadwell]]></category>
		<category><![CDATA[shirtless FBI agent]]></category>

		<guid isPermaLink="false">http://lucatrevisan.wordpress.com/?p=2618</guid>
		<description><![CDATA[Click for full size (Chart by Hilary Sargent Ramadei)<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2618&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Click for full size</p>
<p><a href="http://lucatrevisan.files.wordpress.com/2012/11/clstrfck1.jpg"><img src="http://lucatrevisan.files.wordpress.com/2012/11/clstrfck1.jpg?w=300&#038;h=238" alt="" title="clstrfck" width="300" height="238" class="aligncenter size-medium wp-image-2619" /></a></p>
<p>(Chart by <a href="http://lilsarg.com/" />Hilary Sargent Ramadei</a>)</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/lucatrevisan.wordpress.com/2618/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/lucatrevisan.wordpress.com/2618/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=lucatrevisan.wordpress.com&#038;blog=821887&#038;post=2618&#038;subd=lucatrevisan&#038;ref=&#038;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://lucatrevisan.wordpress.com/2012/11/14/this-helps-a-lot/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:content url="http://1.gravatar.com/avatar/1b8146c6b6915dd379892ea751ca5dba?s=96&#38;d=http%3A%2F%2F1.gravatar.com%2Favatar%2Fad516503a11cd5ca435acc9bb6523536%3Fs%3D96" medium="image">
			<media:title type="html">luca</media:title>
		</media:content>

		<media:content url="http://lucatrevisan.files.wordpress.com/2012/11/clstrfck1.jpg?w=300" medium="image">
			<media:title type="html">clstrfck</media:title>
		</media:content>
	</item>
	</channel>
</rss>
