summaryrefslogtreecommitdiff
path: root/test/test-pages
diff options
context:
space:
mode:
authorAndres Rey <[email protected]>2016-12-22 21:48:49 -0300
committerAndres Rey <[email protected]>2016-12-22 21:48:49 -0300
commitd024c2d80a38d721d6d1d0fd812a706a5fc22562 (patch)
treef19ea7f62cc07f702086182dfac59b9c5397ace3 /test/test-pages
parente9737116493b2dd2893a9a5ac44d0e768dc363bd (diff)
Corrected all the test cases
Diffstat (limited to 'test/test-pages')
-rw-r--r--test/test-pages/remove-extra-brs/expected.html2
-rw-r--r--test/test-pages/remove-script-tags/expected.html27
-rw-r--r--test/test-pages/reordering-paragraphs/expected.html28
-rw-r--r--test/test-pages/replace-brs/expected.html22
-rw-r--r--test/test-pages/salon-1/expected.html245
-rw-r--r--test/test-pages/social-buttons/expected.html39
-rw-r--r--test/test-pages/svg-parsing/expected.html46
-rw-r--r--test/test-pages/tmz-1/expected.html48
-rw-r--r--test/test-pages/wapo-2/expected.html132
9 files changed, 465 insertions, 124 deletions
diff --git a/test/test-pages/remove-extra-brs/expected.html b/test/test-pages/remove-extra-brs/expected.html
index 3766c0f..f8f8a6c 100644
--- a/test/test-pages/remove-extra-brs/expected.html
+++ b/test/test-pages/remove-extra-brs/expected.html
@@ -1,5 +1,5 @@
<div>
- <br></br><p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
tempor incididunt ut labore et dolore magna aliqua.</p>
<p><p>Ut enim ad minim veniam,
quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
diff --git a/test/test-pages/remove-script-tags/expected.html b/test/test-pages/remove-script-tags/expected.html
index 11a4c51..769cc06 100644
--- a/test/test-pages/remove-script-tags/expected.html
+++ b/test/test-pages/remove-script-tags/expected.html
@@ -1,8 +1,19 @@
- <div>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.</p>
- <p>Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.</p>
- <p>Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- </div>
- <div>
- <p>Tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.</p>
- <p>Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p> \ No newline at end of file
+<div>
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua.</p>
+ <p>Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat.</p>
+ <p>Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ </div><div>
+ <p>Tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat.</p>
+ <p>Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur.
+
+ Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ </div> \ No newline at end of file
diff --git a/test/test-pages/reordering-paragraphs/expected.html b/test/test-pages/reordering-paragraphs/expected.html
index 506f291..4a46dd5 100644
--- a/test/test-pages/reordering-paragraphs/expected.html
+++ b/test/test-pages/reordering-paragraphs/expected.html
@@ -1,2 +1,26 @@
- <p id="first">Regarding item# 11111, under sufficiently extreme conditions, quarks may become deconfined and exist as free particles. In the course of asymptotic freedom, the strong interaction becomes weaker at higher temperatures. Eventually, color confinement would be lost and an extremely hot plasma of freely moving quarks and gluons would be formed. This theoretical phase of matter is called quark-gluon plasma.[81] The exact conditions needed to give rise to this state are unknown and have been the subject of a great deal of speculation and experimentation.</p>
- <p id="second">Regarding item# 22222, under sufficiently extreme conditions, quarks may become deconfined and exist as free particles. In the course of asymptotic freedom, the strong interaction becomes weaker at higher temperatures. Eventually, color confinement would be lost and an extremely hot plasma of freely moving quarks and gluons would be formed. This theoretical phase of matter is called quark-gluon plasma.[81] The exact conditions needed to give rise to this state are unknown and have been the subject of a great deal of speculation and experimentation.</p> \ No newline at end of file
+<div>
+ <p id="first">Regarding item# 11111, under sufficiently extreme conditions, quarks may
+ become deconfined and exist as free particles. In the course of asymptotic
+ freedom, the strong interaction becomes weaker at higher temperatures.
+ Eventually, color confinement would be lost and an extremely hot plasma
+ of freely moving quarks and gluons would be formed. This theoretical phase
+ of matter is called quark-gluon plasma.[81] The exact conditions needed
+ to give rise to this state are unknown and have been the subject of a great
+ deal of speculation and experimentation.</p>
+ <p id="second">Regarding item# 22222, under sufficiently extreme conditions, quarks may
+ become deconfined and exist as free particles. In the course of asymptotic
+ freedom, the strong interaction becomes weaker at higher temperatures.
+ Eventually, color confinement would be lost and an extremely hot plasma
+ of freely moving quarks and gluons would be formed. This theoretical phase
+ of matter is called quark-gluon plasma.[81] The exact conditions needed
+ to give rise to this state are unknown and have been the subject of a great
+ deal of speculation and experimentation.</p>
+ <p id="third">Regarding item# 33333, under sufficiently extreme conditions, quarks may
+ become deconfined and exist as free particles. In the course of asymptotic
+ freedom, the strong interaction becomes weaker at higher temperatures.
+ Eventually, color confinement would be lost and an extremely hot plasma
+ of freely moving quarks and gluons would be formed. This theoretical phase
+ of matter is called quark-gluon plasma.[81] The exact conditions needed
+ to give rise to this state are unknown and have been the subject of a great
+ deal of speculation and experimentation.</p>
+ <br id="br2"></br></div> \ No newline at end of file
diff --git a/test/test-pages/replace-brs/expected.html b/test/test-pages/replace-brs/expected.html
index 0e6b251..ba2d4fd 100644
--- a/test/test-pages/replace-brs/expected.html
+++ b/test/test-pages/replace-brs/expected.html
@@ -1,8 +1,14 @@
- <div>
- <p style="display: inline;" class="readability-styled"> Lorem ipsum</p>
- <p style="display: inline;" class="readability-styled">dolor sit</p>
- <p> amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. </p>
- </div>
- <div>
- <p style="display: inline;" class="readability-styled"> Tempor</p>
- <p>incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. </p> \ No newline at end of file
+<div><p>
+ Lorem ipsum</p><p>dolor sit</p><p>amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
+ </p></div><div><p>
+ Tempor</p><p>incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
+ </p></div> \ No newline at end of file
diff --git a/test/test-pages/salon-1/expected.html b/test/test-pages/salon-1/expected.html
index 71341bf..d8d3029 100644
--- a/test/test-pages/salon-1/expected.html
+++ b/test/test-pages/salon-1/expected.html
@@ -1,39 +1,206 @@
- <p>Horror stories about the increasingly unpopular taxi service Uber have been commonplace in recent months, but there is still much to be learned from its handling of the recent hostage drama in downtown Sydney, Australia. We’re told that we reveal our true character in moments of crisis, and apparently that’s as true for companies as it is for individuals.</p>
- <p>A number of experts have challenged the idea that the horrific explosion of violence in a Sydney café was “terrorism,” since the attacker was mentally unbalanced and acted alone. But, terror or not, the ordeal was certainly terrifying. Amid the chaos and uncertainty, the city believed itself to be under a coordinated and deadly attack.</p>
- <p>Uber had an interesting, if predictable, response to the panic and mayhem: It raised prices. A lot.</p>
- <p>In case you missed the story, the facts are these: Someone named Man Haron Monis, who was considered mentally unstable and had been investigated for murdering his ex-wife, seized hostages in a café that was located in Sydney’s Central Business District or “CBD.” In the process he put up an Islamic flag – “igniting,” as <a href="http://www.reuters.com/article/2014/12/15/us-australia-security-idUSKBN0JS0WX20141215">Reuters</a> reported, “fears of a jihadist attack in the heart of the country’s biggest city.”</p>
- <p>In the midst of the fear, Uber stepped in and tweeted this announcement:&nbsp; <span>“We are all concerned with events in CBD. Fares have increased to encourage
- more drivers to come online &amp; pick up passengers in the area.”</span> </p>
- <p>As <a href="http://mashable.com/2014/12/14/uber-sydney-surge-pricing/">Mashable </a>reports, the company announced that it would charge a minimum of $100 Australian to take passengers from the area immediately surrounding the ongoing crisis, and prices increased by as much as four times the standard amount. A firestorm of criticism quickly erupted – “<a href="https://twitter.com/Uber_Sydney">@Uber_Sydney</a> stop being assholes,” one Twitter response began – and Uber soon found itself offering free rides out of the troubled area instead.</p>
- <p>That opener suggests that Uber, as part of a community under siege, is preparing to respond in a civic manner.<em></em> </p>
- <p><em>“… Fares have increased to encourage more drivers to come online &amp; pick up passengers in the area.”</em> </p>
- <div class="toggle-group target hideOnInit" data-toggle-group="story-13850779">
- <p>But, despite the expression of shared concern, there is no sense of <em>civitas</em> to be found in the statement that follows. There is only a transaction, executed at what the corporation believes to be market value. Lesson #1 about Uber is, therefore, that in its view there is no heroism, only self-interest. This is Ayn Rand’s brutal, irrational and primitive philosophy in its purest form: altruism is evil, and self-interest is the only true heroism.<em></em> </p>
- <p>There was once a time when we might have read of “hero cabdrivers” or “hero bus drivers” placing themselves in harm’s way to rescue their fellow citizens. For its part, Uber might have suggested that it would use its network of drivers and its scheduling software to recruit volunteer drivers for a rescue mission.<em></em> </p>
- <p>Instead, we are told that Uber’s pricing surge <em>was</em> its expression of concern. Uber’s way to address a human crisis is apparently by letting the market govern human behavior, as if there were (in libertarian economist Tyler Cowen’s phrase) “markets in everything” – including the lives of a city’s beleaguered citizens (and its Uber drivers). <em></em> </p>
- <p>Where would this kind of market-driven practice leave poor or middle-income citizens in a time of crisis? If they can’t afford the “surged” price, apparently it would leave them squarely in the line of fire. And come to think of it, why would Uber drivers value their lives so cheaply, unless they’re underpaid? <em></em> </p>
- <p>One of the lessons of Sydney is this: Uber’s philosophy, whether consciously expressed or not, is that life belongs to the highest bidder – and therefore, by implication, the highest bidder’s life has the greatest value. Society, on the other hand, may choose to believe that every life has equal value – or that lifesaving services should be available at affordable prices. <em></em> </p>
- <p>If nothing else, the Sydney experience should prove once and for all that there is no such thing as “the sharing economy.” Uber is a taxi company, albeit an under-regulated one, and nothing more. It’s certainly not a “ride sharing” service, where someone who happens to be going in the same direction is willing to take along an extra passenger and split gas costs. A ride-sharing service wouldn’t find itself “increasing fares to encourage more drivers” to come into Sydney’s terrorized Central Business District. <em></em> </p>
- <p>A “sharing economy,” by definition, is lateral in structure. It is a peer-to-peer economy. But Uber, as its name suggests, is hierarchical in structure. It monitors and controls its drivers, demanding that they purchase services from it while guiding their movements and determining their level of earnings. And its pricing mechanisms impose unpredictable costs on its customers, extracting greater amounts whenever the data suggests customers can be compelled to pay them.<em></em> </p>
- <p>This is a top-down economy, not a “shared” one.<em></em> </p>
- <p>A number of Uber’s fans and supporters defended the company on the grounds that its “surge prices,” including those seen during the Sydney crisis, are determined by an algorithm. But an algorithm can be an ideological statement, and is always a cultural artifact. As human creations, algorithms reflect their creators. <em></em> </p>
- <p>Uber’s tweet during the Sydney crisis made it sound as if human intervention, rather than algorithmic processes, caused prices to soar that day. But it doesn’t really matter if that surge was manually or algorithmically driven. Either way the prices were Uber’s doing – and its moral choice.<em></em> </p>
- <p>Uber has been strenuously defending its surge pricing in the wake of accusations (apparently <a href="http://gothamist.com/2012/11/04/uber.php">justified</a>) that the company enjoyed windfall profits during Hurricane Sandy. It has now promised the state of New York that it will cap its surge prices (at three times the highest rate on two non-emergency days). But if Uber has its way, it will soon enjoy a monopolistic stranglehold on car service rates in most major markets. And it has demonstrated its willingness to ignore rules and regulations. That means<em> </em>predictable and affordable taxi fares could become a thing of the past. <em></em> </p>
- <p>In practice, surge pricing could become a new, privatized form of taxation on middle-class taxi customers.<em></em> </p>
- <p>Even without surge pricing, Uber and its supporters are hiding its full costs. When middle-class workers are underpaid or deprived of benefits and full working rights, as Uber’s <a href="http://www.businessinsider.com/uber-drivers-say-theyre-making-less-than-minimum-wage-2014-10">reportedly are</a>, the entire middle-class economy suffers. Overall wages and benefits are suppressed for the majority, while the wealthy few are made even richer. The invisible costs of ventures like Uber are extracted over time, far surpassing whatever short-term savings they may occasionally offer.<em></em> </p>
- <p>Like Walmart, Uber underpays its employees – many of its drivers <em>are</em> employees, in everything but name – and then drains the social safety net to make up the difference. While Uber preaches libertarianism, it practices a form of corporate welfare. It’s reportedly <a href="http://www.washingtonpost.com/blogs/wonkblog/wp/2014/11/17/why-uber-loves-obamacare/">celebrating Obamacare</a>, for example, since the Affordable Care Act allows it to avoid providing health insurance to its workforce. But the ACA’s subsidies, together with Uber’s often woefully insufficient wages, mean that the rest of us are paying its tab instead. And the lack of income security among Uber’s drivers creates another social cost for Americans – in lost tax revenue, and possibly in increased use of social services. <em></em> </p>
- <p>The company’s war on regulation will also carry a social price. Uber and its supporters don’t seem to understand that<em> </em>regulations exist for a reason. It’s true that nobody likes excessive bureaucracy, but not all regulations are excessive or onerous. And when they are, it’s a flaw in execution rather than principle. <em></em> </p>
- <p>Regulations were created because they serve a social purpose, ensuring the free and fair exchange of services and resources among all segments of society. Some services, such as transportation, are of such importance that the public has a vested interest in ensuring they will be readily available at reasonably affordable prices. That’s not unreasonable for taxi services, especially given the fact that they profit from publicly maintained roads and bridges.<em></em> </p>
- <p>Uber has presented itself as a modernized, efficient alternative to government oversight. But it’s an evasion of regulation, not its replacement. As <a href="http://fusion.net/story/33680/the-inside-story-of-how-the-uber-portland-negotiations-broke-down/">Alexis Madrigal</a>reports, Uber has deliberately ignored city regulators and used customer demand to force its model of inadequate self-governance (my conclusion, not his) onto one city after another.<em></em> </p>
- <p>Uber presented itself as a refreshing alternative to the over-bureaucratized world of urban transportation. But that’s a false choice. We can streamline sclerotic city regulators, upgrade taxi fleets and even provide users with fancy apps that make it easier to call a cab. The company’s binary presentation – us, or City Hall – frames the debate in artificial terms.<em></em> </p>
- <p>Uber claims that its driver rating system is a more efficient way to monitor drivers, but that’s an entirely unproven assumption. While taxi drivers have been known to misbehave, the worldwide litany of complaints against Uber drivers – for everything from dirty cars and <a href="http://consumerist.com/2014/07/30/uber-passenger-complains-of-spider-bite-in-filthy-car/">spider bites</a> to <a href="http://www.forbes.com/sites/ellenhuet/2014/09/30/uber-driver-hammer-attack-liability/">assault with a hammer</a>, <a href="http://www.businessinsider.com/uber-nikki-williams-2014-12">fondling</a> and <a href="http://www.businessinsider.com/an-uber-driver-allegedly-raped-a-female-passenger-in-boston-2014-12">rape</a>– suggest that Uber’s system may not work as well as old-fashioned regulation. It’s certainly not noticeably superior.<em></em> </p>
- <p>In fact, <a href="http://www.huffingtonpost.com/2014/12/09/uber-california-lawsuit_n_6298206.html">prosecutors in San Francisco and Los Angeles</a> say Uber has been lying to its customers about the level and quality of its background checks. The company now promises it will do a better job at screening drivers. But it <a href="http://consumerist.com/2014/12/18/uber-reportedly-revamping-security-wont-say-exactly-what-its-doing/">won’t tell us</a> what measures its taking to improve its safety record, and it’s <a href="http://consumerist.com/2014/12/18/uber-reportedly-revamping-security-wont-say-exactly-what-its-doing/">fighting the kind of driver scrutiny</a> that taxicab companies have been required to enforce for many decades. <em></em> </p>
- <p>Many reports suggest that beleaguered drivers don’t feel much better about the company than victimized passengers do. They tell <a href="http://qz.com/299655/why-your-uber-driver-hates-uber/">horror stories</a> about the company’s hiring and management practices. Uber <a href="http://www.salon.com/2014/09/03/uber_unrest_drivers_in_los_angeles_protest_the_slashing_of_rates/">unilaterally slashes drivers’ rates</a>, while claiming they don’t need to unionize. (The <a href="http://www.fastcompany.com/3037371/the-teamsters-of-the-21st-century-how-uber-lyft-and-facebook-drivers-are-organizing">Teamsters</a> disagree.) <em></em> </p>
- <p>The company also pushes<a href="http://thinkprogress.org/economy/2014/11/06/3589715/uber-lending-investigation/"> sketchy, substandard loans</a> onto its drivers – but hey, what could go wrong?<em></em> </p>
- <p>Uber has many libertarian defenders. And yet, it <a href="http://pando.com/2014/10/29/uber-prs-latest-trick-impersonating-its-drivers-and-trying-to-scam-journalists/">deceives the press</a> and <a href="http://www.slate.com/blogs/the_slatest/2014/11/17/uber_exec_suggests_using_personal_info_against_journalists.html">threatens to spy on journalists</a>, <a href="http://money.cnn.com/2014/08/04/technology/uber-lyft/">lies to its own employees</a>, keeps its practices a secret and routinely invades the privacy of civilians – sometimes merely for entertainment. (It has a tool, with the Orwellian name the “<a href="http://www.forbes.com/sites/kashmirhill/2014/10/03/god-view-uber-allegedly-stalked-users-for-party-goers-viewing-pleasure/">God View</a>,” that it can use for monitoring customers’ personal movements.) <em></em> </p>
- <p>Aren’t those the kinds of things libertarians say they hate about <em>government</em>?<em></em> </p>
- <p>This isn’t a “gotcha” exercise. It matters. Uber is the poster child for the pro-privatization, anti-regulatory ideology that ascribes magical powers to technology and the private sector. It is deeply a political entity, from its Nietzschean name to its recent hiring of White House veteran David Plouffe. Uber is built around a relatively simple app (which relies on government-created technology), but it’s not really a tech company. Above all else Uber is an ideological campaign, a neoliberal project whose real products are deregulation and the dismantling of the social contract.<em></em> </p>
- <p>Or maybe, as that tweeter in Sydney suggested, they’re just assholes.<em></em> </p>
- <p>Either way, it’s important that Uber’s worldview and business practices not be allowed to “disrupt” our economy or our social fabric. People who work hard deserve to make a decent living. Society at large deserves access to safe and affordable transportation. And government, as the collective expression of a democratic society, has a role to play in protecting its citizens. <em></em> </p>
- <p>And then there’s the matter of our collective psyche. In her book “A Paradise Built in Hell: The Extraordinary Communities that Arise in Disaster,” Rebecca Solnit wrote of the purpose, meaning and deep satisfaction people find when they pull together to help one another in the face of adversity.&nbsp; But in the world Uber seeks to create, those surges of the spirit would be replaced by surge pricing.<em></em> </p>
- <p>You don’t need a “God view” to see what happens next. When heroism is reduced to a transaction, the soul of a society is sold cheap. <em></em> </p> \ No newline at end of file
+<p>Horror stories about the increasingly unpopular taxi service Uber have
+ been commonplace in recent months, but there is still much to be learned
+ from its handling of the recent hostage drama in downtown Sydney, Australia.
+ We’re told that we reveal our true character in moments of crisis, and
+ apparently that’s as true for companies as it is for individuals.</p><p>A number of experts have challenged the idea that the horrific explosion
+ of violence in a Sydney café was “terrorism,” since the attacker was mentally
+ unbalanced and acted alone. But, terror or not, the ordeal was certainly
+ terrifying. Amid the chaos and uncertainty, the city believed itself to
+ be under a coordinated and deadly attack.</p><p>Uber had an interesting, if predictable, response to the panic and mayhem:
+ It raised prices. A lot.</p><p>In case you missed the story, the facts are these: Someone named Man Haron
+ Monis, who was considered mentally unstable and had been investigated for
+ murdering his ex-wife, seized hostages in a café that was located in Sydney’s
+ Central Business District or “CBD.” In the process he put up an Islamic
+ flag – “igniting,” as <a href="http://www.reuters.com/article/2014/12/15/us-australia-security-idUSKBN0JS0WX20141215">Reuters</a> reported,
+ “fears of a jihadist attack in the heart of the country’s biggest city.”</p><p>In the midst of the fear, Uber stepped in and tweeted this announcement: 
+ <span style="font-size: 13px;">“We are all concerned with events in CBD. Fares have increased to encourage
+ more drivers to come online &amp; pick up passengers in the area.”</span>
+ </p><p>As <a href="http://mashable.com/2014/12/14/uber-sydney-surge-pricing/">Mashable </a>reports,
+ the company announced that it would charge a minimum of $100 Australian
+ to take passengers from the area immediately surrounding the ongoing crisis,
+ and prices increased by as much as four times the standard amount. A firestorm
+ of criticism quickly erupted – “<a href="https://twitter.com/Uber_Sydney">@Uber_Sydney</a> stop
+ being assholes,” one Twitter response began – and Uber soon found itself
+ offering free rides out of the troubled area instead.</p><p>That opener suggests that Uber, as part of a community under siege, is
+ preparing to respond in a civic manner.<em></em>
+ </p><p><em>“… Fares have increased to encourage more drivers to come online &amp; pick up passengers in the area.”</em>
+ </p><div class="toggle-group target hideOnInit" data-toggle-group="story-13850779">
+ <p>But, despite the expression of shared concern, there is no sense of <em>civitas</em> to
+ be found in the statement that follows. There is only a transaction, executed
+ at what the corporation believes to be market value. Lesson #1 about Uber
+ is, therefore, that in its view there is no heroism, only self-interest.
+ This is Ayn Rand’s brutal, irrational and primitive philosophy in its purest
+ form: altruism is evil, and self-interest is the only true heroism.<em></em>
+ </p>
+ <p>There was once a time when we might have read of “hero cabdrivers” or
+ “hero bus drivers” placing themselves in harm’s way to rescue their fellow
+ citizens. For its part, Uber might have suggested that it would use its
+ network of drivers and its scheduling software to recruit volunteer drivers
+ for a rescue mission.<em></em>
+ </p>
+ <p>Instead, we are told that Uber’s pricing surge <em>was</em> its expression
+ of concern. Uber’s way to address a human crisis is apparently by letting
+ the market govern human behavior, as if there were (in libertarian economist
+ Tyler Cowen’s phrase) “markets in everything” – including the lives of
+ a city’s beleaguered citizens (and its Uber drivers). <em></em>
+ </p>
+ <p>Where would this kind of market-driven practice leave poor or middle-income
+ citizens in a time of crisis? If they can’t afford the “surged” price,
+ apparently it would leave them squarely in the line of fire. And come to
+ think of it, why would Uber drivers value their lives so cheaply, unless
+ they’re underpaid? <em></em>
+ </p>
+ <p>One of the lessons of Sydney is this: Uber’s philosophy, whether consciously
+ expressed or not, is that life belongs to the highest bidder – and therefore,
+ by implication, the highest bidder’s life has the greatest value. Society,
+ on the other hand, may choose to believe that every life has equal value
+ – or that lifesaving services should be available at affordable prices. <em></em>
+ </p>
+ <p>If nothing else, the Sydney experience should prove once and for all that
+ there is no such thing as “the sharing economy.” Uber is a taxi company,
+ albeit an under-regulated one, and nothing more. It’s certainly not a “ride
+ sharing” service, where someone who happens to be going in the same direction
+ is willing to take along an extra passenger and split gas costs. A ride-sharing
+ service wouldn’t find itself “increasing fares to encourage more drivers”
+ to come into Sydney’s terrorized Central Business District. <em></em>
+ </p>
+ <p>A “sharing economy,” by definition, is lateral in structure. It is a peer-to-peer
+ economy. But Uber, as its name suggests, is hierarchical in structure.
+ It monitors and controls its drivers, demanding that they purchase services
+ from it while guiding their movements and determining their level of earnings.
+ And its pricing mechanisms impose unpredictable costs on its customers,
+ extracting greater amounts whenever the data suggests customers can be
+ compelled to pay them.<em></em>
+ </p>
+ <p>This is a top-down economy, not a “shared” one.<em></em>
+ </p>
+ <p>A number of Uber’s fans and supporters defended the company on the grounds
+ that its “surge prices,” including those seen during the Sydney crisis,
+ are determined by an algorithm. But an algorithm can be an ideological
+ statement, and is always a cultural artifact. As human creations, algorithms
+ reflect their creators. <em></em>
+ </p>
+ <p>Uber’s tweet during the Sydney crisis made it sound as if human intervention,
+ rather than algorithmic processes, caused prices to soar that day. But
+ it doesn’t really matter if that surge was manually or algorithmically
+ driven. Either way the prices were Uber’s doing – and its moral choice.<em></em>
+ </p>
+ <p>Uber has been strenuously defending its surge pricing in the wake of accusations
+ (apparently <a href="http://gothamist.com/2012/11/04/uber.php">justified</a>)
+ that the company enjoyed windfall profits during Hurricane Sandy. It has
+ now promised the state of New York that it will cap its surge prices (at
+ three times the highest rate on two non-emergency days). But if Uber has
+ its way, it will soon enjoy a monopolistic stranglehold on car service
+ rates in most major markets. And it has demonstrated its willingness to
+ ignore rules and regulations. That means<em> </em>predictable and affordable
+ taxi fares could become a thing of the past. <em></em>
+ </p>
+ <p>In practice, surge pricing could become a new, privatized form of taxation
+ on middle-class taxi customers.<em></em>
+ </p>
+ <p>Even without surge pricing, Uber and its supporters are hiding its full
+ costs. When middle-class workers are underpaid or deprived of benefits
+ and full working rights, as Uber’s <a href="http://www.businessinsider.com/uber-drivers-say-theyre-making-less-than-minimum-wage-2014-10">reportedly are</a>,
+ the entire middle-class economy suffers. Overall wages and benefits are
+ suppressed for the majority, while the wealthy few are made even richer.
+ The invisible costs of ventures like Uber are extracted over time, far
+ surpassing whatever short-term savings they may occasionally offer.<em></em>
+ </p>
+ <p>Like Walmart, Uber underpays its employees – many of its drivers <em>are</em> employees,
+ in everything but name – and then drains the social safety net to make
+ up the difference. While Uber preaches libertarianism, it practices a form
+ of corporate welfare. It’s reportedly <a href="http://www.washingtonpost.com/blogs/wonkblog/wp/2014/11/17/why-uber-loves-obamacare/">celebrating Obamacare</a>,
+ for example, since the Affordable Care Act allows it to avoid providing
+ health insurance to its workforce. But the ACA’s subsidies, together with
+ Uber’s often woefully insufficient wages, mean that the rest of us are
+ paying its tab instead. And the lack of income security among Uber’s drivers
+ creates another social cost for Americans – in lost tax revenue, and possibly
+ in increased use of social services. <em></em>
+ </p>
+ <p>The company’s war on regulation will also carry a social price. Uber and
+ its supporters don’t seem to understand that<em> </em>regulations exist
+ for a reason. It’s true that nobody likes excessive bureaucracy, but not
+ all regulations are excessive or onerous. And when they are, it’s a flaw
+ in execution rather than principle. <em></em>
+ </p>
+ <p>Regulations were created because they serve a social purpose, ensuring
+ the free and fair exchange of services and resources among all segments
+ of society. Some services, such as transportation, are of such importance
+ that the public has a vested interest in ensuring they will be readily
+ available at reasonably affordable prices. That’s not unreasonable for
+ taxi services, especially given the fact that they profit from publicly
+ maintained roads and bridges.<em></em>
+ </p>
+ <p>Uber has presented itself as a modernized, efficient alternative to government
+ oversight. But it’s an evasion of regulation, not its replacement. As
+ <a href="http://fusion.net/story/33680/the-inside-story-of-how-the-uber-portland-negotiations-broke-down/">Alexis Madrigal</a>reports, Uber has deliberately ignored city regulators
+ and used customer demand to force its model of inadequate self-governance
+ (my conclusion, not his) onto one city after another.<em></em>
+ </p>
+ <p>Uber presented itself as a refreshing alternative to the over-bureaucratized
+ world of urban transportation. But that’s a false choice. We can streamline
+ sclerotic city regulators, upgrade taxi fleets and even provide users with
+ fancy apps that make it easier to call a cab. The company’s binary presentation
+ – us, or City Hall – frames the debate in artificial terms.<em></em>
+ </p>
+ <p>Uber claims that its driver rating system is a more efficient way to monitor
+ drivers, but that’s an entirely unproven assumption. While taxi drivers
+ have been known to misbehave, the worldwide litany of complaints against
+ Uber drivers – for everything from dirty cars and <a href="http://consumerist.com/2014/07/30/uber-passenger-complains-of-spider-bite-in-filthy-car/">spider bites</a> to
+ <a href="http://www.forbes.com/sites/ellenhuet/2014/09/30/uber-driver-hammer-attack-liability/">assault with a hammer</a>, <a href="http://www.businessinsider.com/uber-nikki-williams-2014-12">fondling</a> and
+ <a href="http://www.businessinsider.com/an-uber-driver-allegedly-raped-a-female-passenger-in-boston-2014-12">rape</a>– suggest that Uber’s system may not work as well as old-fashioned
+ regulation. It’s certainly not noticeably superior.<em></em>
+ </p>
+ <p>In fact, <a href="http://www.huffingtonpost.com/2014/12/09/uber-california-lawsuit_n_6298206.html">prosecutors in San Francisco and Los Angeles</a> say
+ Uber has been lying to its customers about the level and quality of its
+ background checks. The company now promises it will do a better job at
+ screening drivers. But it <a href="http://consumerist.com/2014/12/18/uber-reportedly-revamping-security-wont-say-exactly-what-its-doing/">won’t tell us</a> what
+ measures its taking to improve its safety record, and it’s <a href="http://consumerist.com/2014/12/18/uber-reportedly-revamping-security-wont-say-exactly-what-its-doing/">fighting the kind of driver scrutiny</a> that
+ taxicab companies have been required to enforce for many decades. <em></em>
+ </p>
+ <p>Many reports suggest that beleaguered drivers don’t feel much better about
+ the company than victimized passengers do. They tell <a href="http://qz.com/299655/why-your-uber-driver-hates-uber/">horror stories</a> about
+ the company’s hiring and management practices. Uber <a href="http://www.salon.com/2014/09/03/uber_unrest_drivers_in_los_angeles_protest_the_slashing_of_rates/">unilaterally slashes drivers’ rates</a>,
+ while claiming they don’t need to unionize. (The <a href="http://www.fastcompany.com/3037371/the-teamsters-of-the-21st-century-how-uber-lyft-and-facebook-drivers-are-organizing">Teamsters</a> disagree.) <em></em>
+ </p>
+ <p>The company also pushes<a href="http://thinkprogress.org/economy/2014/11/06/3589715/uber-lending-investigation/"> sketchy, substandard loans</a> onto
+ its drivers – but hey, what could go wrong?<em></em>
+ </p>
+ <p>Uber has many libertarian defenders. And yet, it <a href="http://pando.com/2014/10/29/uber-prs-latest-trick-impersonating-its-drivers-and-trying-to-scam-journalists/">deceives the press</a> and
+ <a href="http://www.slate.com/blogs/the_slatest/2014/11/17/uber_exec_suggests_using_personal_info_against_journalists.html">threatens to spy on journalists</a>, <a href="http://money.cnn.com/2014/08/04/technology/uber-lyft/">lies to its own employees</a>,
+ keeps its practices a secret and routinely invades the privacy of civilians
+ – sometimes merely for entertainment. (It has a tool, with the Orwellian
+ name the “<a href="http://www.forbes.com/sites/kashmirhill/2014/10/03/god-view-uber-allegedly-stalked-users-for-party-goers-viewing-pleasure/">God View</a>,”
+ that it can use for monitoring customers’ personal movements.) <em></em>
+ </p>
+ <p>Aren’t those the kinds of things libertarians say they hate about <em>government</em>?<em></em>
+ </p>
+ <p>This isn’t a “gotcha” exercise. It matters. Uber is the poster child for
+ the pro-privatization, anti-regulatory ideology that ascribes magical powers
+ to technology and the private sector. It is deeply a political entity,
+ from its Nietzschean name to its recent hiring of White House veteran David
+ Plouffe. Uber is built around a relatively simple app (which relies on
+ government-created technology), but it’s not really a tech company. Above
+ all else Uber is an ideological campaign, a neoliberal project whose real
+ products are deregulation and the dismantling of the social contract.<em></em>
+ </p>
+ <p>Or maybe, as that tweeter in Sydney suggested, they’re just assholes.<em></em>
+ </p>
+ <p>Either way, it’s important that Uber’s worldview and business practices
+ not be allowed to “disrupt” our economy or our social fabric. People who
+ work hard deserve to make a decent living. Society at large deserves access
+ to safe and affordable transportation. And government, as the collective
+ expression of a democratic society, has a role to play in protecting its
+ citizens. <em></em>
+ </p>
+ <p>And then there’s the matter of our collective psyche. In her book “A Paradise
+ Built in Hell: The Extraordinary Communities that Arise in Disaster,” Rebecca
+ Solnit wrote of the purpose, meaning and deep satisfaction people find
+ when they pull together to help one another in the face of adversity. 
+ But in the world Uber seeks to create, those surges of the spirit would
+ be replaced by surge pricing.<em></em>
+ </p>
+ <p>You don’t need a “God view” to see what happens next. When heroism is
+ reduced to a transaction, the soul of a society is sold cheap. <em></em>
+ </p>
+ </div> \ No newline at end of file
diff --git a/test/test-pages/social-buttons/expected.html b/test/test-pages/social-buttons/expected.html
index 7357ee0..3810cde 100644
--- a/test/test-pages/social-buttons/expected.html
+++ b/test/test-pages/social-buttons/expected.html
@@ -1,6 +1,33 @@
- <article class="main-content">
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p> \ No newline at end of file
+<article class="main-content">
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+ tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+ quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+ consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+ cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+ proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+ </article> \ No newline at end of file
diff --git a/test/test-pages/svg-parsing/expected.html b/test/test-pages/svg-parsing/expected.html
index bbeaa40..1cc4559 100644
--- a/test/test-pages/svg-parsing/expected.html
+++ b/test/test-pages/svg-parsing/expected.html
@@ -1,14 +1,32 @@
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <svg version="1.1" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 50 50" height="50" width="50">
- <g>
- <clippath id="hex-mask-large">
- <polygon points="15,35 10,35 10,0 10,0 45,0 45,35 45,35 25,35 15,43"></polygon>
- </clippath>
- <clippath id="hex-mask-small">
- <polygon points="5,1 5,16 3,23 10,20 24,20 24,1"></polygon>
- </clippath>
- </g>
- </svg>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
- <p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p> \ No newline at end of file
+<div>
+<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+<svg height="50" style="position: absolute;" version="1.1" viewbox="0 0 50 50" width="50" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g><clippath id="hex-mask-large"><polygon points="15,35 10,35 10,0 10,0 45,0 45,35 45,35 25,35 15,43"></polygon></clippath><clippath id="hex-mask-small"><polygon points="5,1 5,16 3,23 10,20 24,20 24,1"></polygon></clippath></g></svg><p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
+tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
+quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo
+consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse
+cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non
+proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
+</div> \ No newline at end of file
diff --git a/test/test-pages/tmz-1/expected.html b/test/test-pages/tmz-1/expected.html
index 1be6cc2..21ed790 100644
--- a/test/test-pages/tmz-1/expected.html
+++ b/test/test-pages/tmz-1/expected.html
@@ -1,16 +1,36 @@
- <div class="post single-post" id="post-2015_02_26_lupita-nyongo-pearl-dress-stolen-oscars">
- <p class="headline">
- <h4 class="hf2">$150K Pearl Oscar Dress ... STOLEN!!!!</h4> </p>
- <h5 class="article-posted-date">
+<div class="post single-post" id="post-2015_02_26_lupita-nyongo-pearl-dress-stolen-oscars">
+ <p>
+
+
+ <h4 class="hf2">$150K Pearl Oscar Dress ... STOLEN!!!!</h4>
+
+ </p>
+ <h5 class="article-posted-date">
2/26/2015 7:11 AM PST BY TMZ STAFF
</h5>
- <div itemprop="articleBody" class="all-post-body group article-content">
- <p class="primary-image-swipe"><span>EXCLUSIVE</span> </p>
- <p> <img alt="0225-lupita-nyongo-getty-01" src="http://ll-media.tmz.com/2015/02/26/0225-lupita-nyongo-getty-4.jpg"/><strong>Lupita Nyong</strong>'<strong>o</strong>'s now-famous Oscar dress -- adorned in pearls -- was stolen right out of her hotel room ... TMZ has learned.</p>
- <p>Law enforcement sources tell TMZ ... the dress was taken out of Lupita's room at The London West Hollywood. The dress is made of pearls ... 6,000 white Akoya pearls. It's valued at $150,000.</p>
- <p>Our sources say Lupita told cops it was taken from her room sometime between 8 AM and 9 PM Wednesday ... while she was gone. &nbsp;</p>
- <p>We're told there is security footage that cops are looking at that could catch the culprit right in the act.&nbsp;</p>
- <p> <img alt="update_graphic_red_bar" src="http://ll-media.tmz.com/2013/11/20/update-graphic-red-bar.jpg"/><strong>12:00 PM PT</strong> -- Sheriff's deputies were at The London Thursday morning. &nbsp;We know they were in the manager's office and we're told they have looked at security footage to determine if they can ID the culprit.</p>
- <p> <img alt="0226-SUB-london-hotel-swipe-tmz-02" src="http://ll-media.tmz.com/2015/02/26/0226-sub-london-hotel-swipe-tmz-11.jpg"/> </p>
- <a name="continued"></a>
- </div> \ No newline at end of file
+
+ <div class="all-post-body group article-content" itemprop="articleBody">
+ <p><span>EXCLUSIVE</span>
+ </p>
+ <p>
+ <img alt="0225-lupita-nyongo-getty-01" src="http://ll-media.tmz.com/2015/02/26/0225-lupita-nyongo-getty-4.jpg"></img><strong>Lupita Nyong</strong>'<strong>o</strong>'s now-famous Oscar dress
+ -- adorned in pearls -- was stolen right out of her hotel room ... TMZ
+ has learned.</p>
+ <p>Law enforcement sources tell TMZ ... the dress was taken out of Lupita's
+ room at The London West Hollywood. The dress is made of pearls ... 6,000
+ white Akoya pearls. It's valued at $150,000.</p>
+ <p>Our sources say Lupita told cops it was taken from her room sometime between
+ 8 AM and 9 PM Wednesday ... while she was gone.  </p>
+ <p>We're told there is security footage that cops are looking at that could
+ catch the culprit right in the act. </p>
+ <p>
+ <img alt="update_graphic_red_bar" src="http://ll-media.tmz.com/2013/11/20/update-graphic-red-bar.jpg"></img><strong>12:00 PM PT</strong> -- Sheriff's deputies were at The London Thursday
+ morning.  We know they were in the manager's office and we're told
+ they have looked at security footage to determine if they can ID the culprit.</p>
+ <p>
+ <img alt="0226-SUB-london-hotel-swipe-tmz-02" src="http://ll-media.tmz.com/2015/02/26/0226-sub-london-hotel-swipe-tmz-11.jpg"></img></p> <a name="continued"></a>
+
+
+ </div>
+
+ </div> \ No newline at end of file
diff --git a/test/test-pages/wapo-2/expected.html b/test/test-pages/wapo-2/expected.html
index 8e72d5a..a42b034 100644
--- a/test/test-pages/wapo-2/expected.html
+++ b/test/test-pages/wapo-2/expected.html
@@ -1,32 +1,100 @@
- <article>
- <p>President Obama told the U.N. General Assembly 18 months ago that he would seek “real breakthroughs on these two issues — Iran’s nuclear program and ­Israeli-Palestinian peace.”</p>
- <p>But <a href="http://www.washingtonpost.com/world/netanyahu-sweeps-to-victory-in-israeli-election/2015/03/18/af4e50ca-ccf2-11e4-8730-4f473416e759_story.html" title="www.washingtonpost.com">Benjamin Netanyahu’s triumph</a> in Tuesday’s parliamentary elections keeps in place an Israeli prime minister who has declared his intention to resist Obama on both of these fronts, guaranteeing two more years of difficult diplomacy between leaders who barely conceal their personal distaste for each other.</p>
- <p>The Israeli election results also suggest that most voters there support Netanyahu’s tough stance on U.S.-led negotiations to limit Iran’s nuclear program and his vow on Monday that there would be <a href="http://www.washingtonpost.com/world/middle_east/on-final-day-of-campaign-netanyahu-says-no-palestinian-state-if-he-wins/2015/03/16/4f4468e8-cbdc-11e4-8730-4f473416e759_story.html" title="www.washingtonpost.com">no independent Palestinian state</a> as long as he is prime minister.</p>
- <p>“On the way to his election victory, Netanyahu broke a lot of crockery in the relationship,” said Martin Indyk, executive vice president of the Brookings Institution and a former U.S. ambassador to Israel. “It can’t be repaired unless both sides have an interest and desire to do so.”</p>
- <p>Aside from Russian President Vladi­mir Putin, few foreign leaders so brazenly stand up to Obama and even fewer among longtime allies.</p>
- <div class="inline-content inline-video">
- <p class="inline-video-caption"> <span class="pb-caption">Israeli Prime Minister Benjamin Netanyahu pledged to form a new governing coalition quickly after an upset election victory that was built on a shift to the right. (Reuters)</span> </p>
- </div>
- <p>In the past, Israeli leaders who risked damaging the country’s most important relationship, that with Washington, tended to pay a price. In 1991, when Prime Minister Yitzhak Shamir opposed the Madrid peace talks, President George H.W. Bush held back loan guarantees to help absorb immigrants from the former Soviet Union. Shamir gave in, but his government soon collapsed.</p>
- <p>But this time, Netanyahu was not hurt by his personal and substantive conflicts with the U.S. president.</p>
- <p>“While the United States is loved and beloved in Israel, President Obama is not,” said Robert M. Danin, a senior fellow at the Council on Foreign Relations. “So the perceived enmity didn’t hurt the way it did with Shamir when he ran afoul of Bush in ’91.”</p>
- <p>Where do U.S.-Israeli relations go from here?</p>
- <p>In the immediate aftermath of Tuesday’s elections, tensions between the two sides continued to run hot. The Obama administration’s first comments on the Israeli election came with a tough warning about some of the pre-election rhetoric from Netanyahu’s Likud party, which tried to rally right-wing support by saying that Arab Israeli voters were “coming out in droves.”</p>
- <p>“The United States and this administration is deeply concerned about rhetoric that seeks to marginalize Arab Israeli citizens,” White House press secretary Josh Earnest told reporters aboard Air Force One. “It undermines the values and democratic ideals that have been important to our democracy and an important part of what binds the United States and Israel together.”</p>
- <p>Earnest added that Netan­yahu’s election-eve disavowal of a two-state solution for Israelis and Palestinians would force the administration to reconsider its approach to peace in the region.</p>
- <p>Over the longer term, a number of analysts say that Obama and Netan­yahu will seek to play down the friction between them and point to areas of continuing cooperation on military and economic issues.</p>
- <p>“Both sides are going to want to turn down the rhetoric,” Danin said. “But it is also a structural problem. They have six years of accumulated history. That’s going to put limits on how far they can go together.”</p>
- <p>The first substantive test could come as early as this month, when the United States hopes that it can finish hammering out the framework of an agreement with Iran.</p>
- <p>Netanyahu strongly warned against making a “bad deal” during his March 3 address to a joint meeting of Congress, an appearance arranged by Republican congressional leaders and criticized by the Obama administration for making U.S.-Israeli relations partisan on both sides so close to the Israeli election.</p>
- <p>If a deal is reached and does not pass muster with Netanyahu, he is likely to work with congressional Republicans to try to scuttle the accord.</p>
- <p>“The Republicans have said they will do what they can to block a deal, and the prime minister has already made clear that he will work with the Republicans against the president,” Indyk said. “That’s where a clash could come, and it’s coming very quickly.”</p>
- <p>The second test — talks with Palestinians — could be even more difficult. In his September 2013 address to the United Nations, Obama hailed signs of hope.</p>
- <p>“Already, Israeli and Palestinian leaders have demonstrated a willingness to take significant political risks,” Obama said in his speech. Palestinian Authority President Mahmoud Abbas “has put aside efforts to shortcut the pursuit of peace and come to the negotiating table. Prime Minister Netanyahu has released Palestinian prisoners and reaffirmed his commitment to a Palestinian state.”</p>
- <p>Today, <a href="http://www.washingtonpost.com/blogs/worldviews/wp/2015/03/18/what-netanyahus-election-victory-means-for-the-palestinians/" title="www.washingtonpost.com">the signals could not differ more</a>. The Palestinian Authority has said that after it joins the International Criminal Court at The Hague on April 1, it will press war crimes charges against Israel for the bloody Gaza conflict during the summer. Israel, which controls tax receipts, has pledged to punish the Palestinian Authority by freezing its tax revenue.</p>
- <p>The United States, which gives hundreds of millions of dollars of economic aid to the Palestinian Authority, would be caught in the middle. It has been trying to persuade both sides to stand down, but Netanyahu’s declaration that there would be no Palestinian state on his watch makes that more difficult.</p>
- <p>“Now it’s hard to see what could persuade the Palestinians” to hold up on their ICC plans, Indyk said. “That has nothing to do with negotiations, but if both sides can’t be persuaded to back down, then they will be on a trajectory that could lead to the collapse of the Palestinian Authority because it can’t pay wages anymore.</p>
- <p>“That could be an issue forced onto the agenda about the same time as a potential nuclear deal.”</p>
- </article>
- <div class="post-body-sig-line">
- <a href="http://www.washingtonpost.com/people/steven-mufson"><img class="post-body-headshot-left" src="http://img.washingtonpost.com/wp-apps/imrs.php?src=http://www.washingtonpost.com/blogs/wonkblog/files/2014/07/mufson_steve.jpg&amp;h=180&amp;w=180"/></a>
- <p class="post-body-bio has-photo">Steven Mufson covers the White House. Since joining The Post, he has covered economics, China, foreign policy and energy.</p> \ No newline at end of file
+<article><p>President Obama told the U.N. General Assembly 18 months ago that he would
+ seek “real breakthroughs on these two issues — Iran’s nuclear program and
+ ­Israeli-Palestinian peace.”</p>
+ <p>But <a href="http://www.washingtonpost.com/world/netanyahu-sweeps-to-victory-in-israeli-election/2015/03/18/af4e50ca-ccf2-11e4-8730-4f473416e759_story.html" title="www.washingtonpost.com">Benjamin Netanyahu’s triumph</a> in Tuesday’s
+ parliamentary elections keeps in place an Israeli prime minister who has
+ declared his intention to resist Obama on both of these fronts, guaranteeing
+ two more years of difficult diplomacy between leaders who barely conceal
+ their personal distaste for each other.</p>
+ <p>The Israeli election results also suggest that most voters there support
+ Netanyahu’s tough stance on U.S.-led negotiations to limit Iran’s nuclear
+ program and his vow on Monday that there would be <a href="http://www.washingtonpost.com/world/middle_east/on-final-day-of-campaign-netanyahu-says-no-palestinian-state-if-he-wins/2015/03/16/4f4468e8-cbdc-11e4-8730-4f473416e759_story.html" title="www.washingtonpost.com">no independent Palestinian state</a> as long
+ as he is prime minister.</p>
+ <p>“On the way to his election victory, Netanyahu broke a lot of crockery
+ in the relationship,” said Martin Indyk, executive vice president of the
+ Brookings Institution and a former U.S. ambassador to Israel. “It can’t
+ be repaired unless both sides have an interest and desire to do so.”</p>
+ <p>Aside from Russian President Vladi­mir Putin, few foreign leaders so brazenly
+ stand up to Obama and even fewer among longtime allies.</p>
+ <div class="inline-content inline-video">
+
+ <p> <span class="pb-caption">Israeli Prime Minister Benjamin Netanyahu pledged to form a new governing coalition quickly after an upset election victory that was built on a shift to the right. (Reuters)</span>
+ </p>
+ </div>
+ <p>In the past, Israeli leaders who risked damaging the country’s most important
+ relationship, that with Washington, tended to pay a price. In 1991, when
+ Prime Minister Yitzhak Shamir opposed the Madrid peace talks, President
+ George H.W. Bush held back loan guarantees to help absorb immigrants from
+ the former Soviet Union. Shamir gave in, but his government soon collapsed.</p>
+ <p>But this time, Netanyahu was not hurt by his personal and substantive
+ conflicts with the U.S. president.</p>
+ <p>“While the United States is loved and beloved in Israel, President Obama
+ is not,” said Robert M. Danin, a senior fellow at the Council on Foreign
+ Relations. “So the perceived enmity didn’t hurt the way it did with Shamir
+ when he ran afoul of Bush in ’91.”</p>
+ <p>Where do U.S.-Israeli relations go from here?</p>
+ <p>In the immediate aftermath of Tuesday’s elections, tensions between the
+ two sides continued to run hot. The Obama administration’s first comments
+ on the Israeli election came with a tough warning about some of the pre-election
+ rhetoric from Netanyahu’s Likud party, which tried to rally right-wing
+ support by saying that Arab Israeli voters were “coming out in droves.”</p>
+ <p>“The United States and this administration is deeply concerned about rhetoric
+ that seeks to marginalize Arab Israeli citizens,” White House press secretary
+ Josh Earnest told reporters aboard Air Force One. “It undermines the values
+ and democratic ideals that have been important to our democracy and an
+ important part of what binds the United States and Israel together.”</p>
+ <p>Earnest added that Netan­yahu’s election-eve disavowal of a two-state
+ solution for Israelis and Palestinians would force the administration to
+ reconsider its approach to peace in the region.</p>
+
+ <p>Over the longer term, a number of analysts say that Obama and Netan­yahu
+ will seek to play down the friction between them and point to areas of
+ continuing cooperation on military and economic issues.</p>
+ <p>“Both sides are going to want to turn down the rhetoric,” Danin said.
+ “But it is also a structural problem. They have six years of accumulated
+ history. That’s going to put limits on how far they can go together.”</p>
+ <p>The first substantive test could come as early as this month, when the
+ United States hopes that it can finish hammering out the framework of an
+ agreement with Iran.</p>
+ <p>Netanyahu strongly warned against making a “bad deal” during his March
+ 3 address to a joint meeting of Congress, an appearance arranged by Republican
+ congressional leaders and criticized by the Obama administration for making
+ U.S.-Israeli relations partisan on both sides so close to the Israeli election.</p>
+ <p>If a deal is reached and does not pass muster with Netanyahu, he is likely
+ to work with congressional Republicans to try to scuttle the accord.</p>
+ <p>“The Republicans have said they will do what they can to block a deal,
+ and the prime minister has already made clear that he will work with the
+ Republicans against the president,” Indyk said. “That’s where a clash could
+ come, and it’s coming very quickly.”</p>
+ <p>The second test — talks with Palestinians — could be even more difficult.
+ In his September 2013 address to the United Nations, Obama hailed signs
+ of hope.</p>
+ <p>“Already, Israeli and Palestinian leaders have demonstrated a willingness
+ to take significant political risks,” Obama said in his speech. Palestinian
+ Authority President Mahmoud Abbas “has put aside efforts to shortcut the
+ pursuit of peace and come to the negotiating table. Prime Minister Netanyahu
+ has released Palestinian prisoners and reaffirmed his commitment to a Palestinian
+ state.”</p>
+ <p>Today, <a href="http://www.washingtonpost.com/blogs/worldviews/wp/2015/03/18/what-netanyahus-election-victory-means-for-the-palestinians/" title="www.washingtonpost.com">the signals could not differ more</a>. The
+ Palestinian Authority has said that after it joins the International Criminal
+ Court at The Hague on April 1, it will press war crimes charges against
+ Israel for the bloody Gaza conflict during the summer. Israel, which controls
+ tax receipts, has pledged to punish the Palestinian Authority by freezing
+ its tax revenue.</p>
+ <p>The United States, which gives hundreds of millions of dollars of economic
+ aid to the Palestinian Authority, would be caught in the middle. It has
+ been trying to persuade both sides to stand down, but Netanyahu’s declaration
+ that there would be no Palestinian state on his watch makes that more difficult.</p>
+ <p>“Now it’s hard to see what could persuade the Palestinians” to hold up
+ on their ICC plans, Indyk said. “That has nothing to do with negotiations,
+ but if both sides can’t be persuaded to back down, then they will be on
+ a trajectory that could lead to the collapse of the Palestinian Authority
+ because it can’t pay wages anymore.</p>
+ <p>“That could be an issue forced onto the agenda about the same time as
+ a potential nuclear deal.”</p>
+
+ </article><div class="post-body-sig-line"><a href="http://www.washingtonpost.com/people/steven-mufson"><img class="post-body-headshot-left" src="http://img.washingtonpost.com/wp-apps/imrs.php?src=http://www.washingtonpost.com/blogs/wonkblog/files/2014/07/mufson_steve.jpg&amp;h=180&amp;w=180"></img></a>
+ <p>Steven Mufson covers the White House. Since joining The Post, he has covered
+ economics, China, foreign policy and energy.</p>
+
+ </div> \ No newline at end of file