Stephen E. Arnold: Open Source HTTP Crawler (Norconex)

Software
0Shares
Stephen E. Arnold
Stephen E. Arnold

Norconex Offers Open Source HTTP Crawler

Most commercial enterprise search vendors offer their own HTTP crawler, and several are open-source. One new entry to the field stands out, though, for its odd blend of web and enterprise search functionality. In the post, “Norconex Gives Back to Open-Source,” Norconex describes their crawler and associated libraries:

“The Norconex HTTP Collector is an HTTP Crawler meant to give the greatest flexibility possible for developers and integrators. It makes it easy for Java developers to add custom features, so no one will get stuck again when dealing with odd requirements, difficult websites, or close-source crawler limitations. . . . The HTTP collector can be used stand-alone or embedded as a library in your own software.

“Norconex may release other collectors for various data sources in the future. In the meantime, we have encapsulated the document parsing process and sending of parsed data to your target search engine or repository into two separate libraries. We are releasing them as Norconex Importer and Norconex Committer.”

Norconex tells us that they focused on a simple configuration, as well as providing features that cannot be found in some existing crawlers. The enterprise search firm was founded in 2007 and is based in Ottawa, Canada.

Cynthia Murrell, July 16, 2013

Sponsored by ArnoldIT.com, developer of Augmentext

SchwartzReport: Truthout on Seven Obstacles to 99% Getting Organized

Collective Intelligence, Cultural Intelligence, Peace Intelligence
0Shares

schwartz reportHere is an excellent essay that addresses an issue that has come to concern me more and more: the apathy of Americans, our passive acceptance of what is happening to our country.

Why Aren't Americans Fighting Back?
E. DOUGLAS KIHN

EXTRACT:

The Current Crisis and Today's Fightbacks

The last four decades have witnessed the first-ever generalized stagnation of wages and benefits for working people in this country, as well as the greatest transfer of wealth in the history of the world, from middle and low income Americans to the billionaire gamblers, bankers, industrialists, and their hirelings. According to Mother Jones, from 1979 to the present, the productivity of American capitalism grew over 80 percent, while US wages only grew around 12 percent.

The share of US wealth held by half of American households plummeted in 2010 to 1.1 percent, while the top 10 percent's share was 74.5 percent. And according to the British aid agency Oxfam, the 2012 income alone of the 100 wealthiest families in the world was enough to end global poverty four times over!

EXTRACT (List Only):

1. Lack of class consciousness.

2. The bad taste left in the collective mouth by the Stalinist experiment.

3. Fossilized, bureaucratic unions.

4. Capitalist electoral politics.

5. Arbitrary divisions of the proletariat.

6. The capitalist propaganda machine.

7. The American security state.

Read full article.

Continue reading “SchwartzReport: Truthout on Seven Obstacles to 99% Getting Organized”

NIGHTWATCH: Syria Documents Rebel Chemical Capability

04 Inter-State Conflict, 05 Civil War, 07 Other Atrocities, 08 Proliferation, IO Deeds of War
0Shares
The Syrian Arab Army seized 281 barrels with chemicals from insurgents at a farm in Banias, Tartus.
The Syrian Arab Army seized 281 barrels with chemicals from insurgents at a farm in Banias, Tartus.

Syria: According to Syria media, and reported by Xinhua, the Syrian armed forces discovered a factory for manufacturing and storing toxic chemical weapons inside a “terrorists'” hideout near Damascus.

An official source told the state news agency, SANA, that “the army unit seized amounts of toxic chemical materials, in addition to seizing chlorine substances in containers, some of them foreign-made, while others were Saudi-made (sic).”

The source said that the haul included weapons and scores of mortar shells which were prepared to be filled with chemical materials. SANA published a photo of the captured materials to accompany the report.

Foreign chemicals seized near Damascus. Some of the chemicals originate in Saudi-Arabia
Foreign chemicals seized near Damascus. Some of the chemicals originate in Saudi-Arabia

Comment: The published report did not identify which opposition group's hideout was captured. This could be a media stunt, but in publishing photos, the government has made itself vulnerable to demands for independent verification. It would be easy to expose, if it is a hoax.

See Also:

Chemicals and Weapons seized from Insurgents in Damascus

Syria claims discovery of chemical materials belonging to rebels

 

Gordon Duff: US Swath of Destruction a Pre-Planned Methodical Population Cleansing Strategy + Eugenics Meta-RECAP

06 Genocide, 07 Other Atrocities
0Shares
Gordon Duff
Gordon Duff

Population Cleansing Wars

Gordon Duff

Veterans Today, 15 July 2013

It is a mistake to look on what has become endless wars, first centering in the Middle East, as struggles over religion, political theories, sectarian struggles or post-colonial realignments.  Each hypothesis fails.

Increasingly, intelligence analysts are agreeing on one thing, there is clear evidence of “game theory/chaos theory” with one clear purpose, to reduce populations in specific areas where key resources are in abundance.

Click on Image to Enlarge
Click on Image to Enlarge

The first hard evidence hit with the discoveries of Dr. Chris Busby, researching the effects of depleted uranium use in the Fallujah region of Iraq.  It took several years to get access to the area.  There was a reason.

Not only was it found that fertility had been suppressed and the region plagued with the onslaught of horrific birth defects but that samples taken from the local population indicated that it wasn’t just depleted uranium but pure, weapons-grade U-235 that was found.

Not only were nuclear weapons used in Iraq but purposefully “dirty” weapons, not the more modern MRR (Minimal Residual Radiation) 3rd and 4th generation nukes developed at Livermore Labs in California after 1991.

It was at that time that their weapons program not only bifurcated into a highly classified area but largely went “dark” with top weapons physicists being kept “out of the loop.”

Thus, we find the use of dirty weapons, never meant to win a battle or reduce an enemy stronghold but to destroy a race.

Then, of course, there is still the issue of the endless tons of depleted uranium, not just Iraq but Gaza, Lebanon, Afghanistan, Yemen, Somalia and perhaps even Syria.

Read full article with videos, links and photos.

Continue reading “Gordon Duff: US Swath of Destruction a Pre-Planned Methodical Population Cleansing Strategy + Eugenics Meta-RECAP”

Mini-Me: Uzbekistan Wants to Join NATO, Conquer Eurasia [We Do Not Make This Stuff Up] — Full Reading [English Below the Line] Makes Clear This Is A Manifesto — From Water to Genocide to Labor to Historical Grievances

02 Diplomacy, 06 Russia, 08 Wild Cards, 09 Justice, 10 Security, 11 Society, 12 Water, Civil Society, Commerce, Cultural Intelligence, Earth Intelligence, Government, IO Deeds of War, IO History, Military, Peace Intelligence
0Shares
Who?  Mini-Me?
Who? Mini-Me?

Huh?

Uzbekistan Media: We Should Join NATO, Conquer Eurasia

A recent piece in Uzbekistan's state-sanctioned media has advocated joining NATO and taking over the territory of Tajikistan, Kyrgyzstan, and most of the rest of Eurasia. The piece, published on 12news.uz, was taken down shortly after being published, but was preserved on inoSMI.ru.  [PBI: English translation below the line.]

The piece, at nearly 9,000 words, offers a number of controversial (to put it kindly) claims: that Tajiks are merely Persian-speaking Uzbeks, that Uzbekistan is the successor state to the Mongol Golden Horde, that the agreement between Russia and Kyrgyzstan to develop hydropower plants is invalid because it misspells “Kyrgyzstan,” among many others. Its main thesis, however, is that the “threats of a natural-technical character” — namely proposed hydropower plants in Tajikistan and Kyrgyzstan — are the gravest security threats facing Uzbekistan, comparable to a nuclear bomb. And the solution is that Uzbekistan should join NATO.

ca water 3The piece is a bit out there, but Uzbek analysts point out that it must have been officially sanctioned. “This site [12news.uz] is not just semi-official, it’s official,” dissident political analyst Tashpulat Yuldashev told uznews.net. “It's curated by Dilshod Nurullaev, former Security Commission chairman and advisor to the President,” he said. “There is total censorship in Uzbekistan, and such a politically charged article would not have been allowed to be published without permission from the very top.” That assertion was backed up by another Uzbek analyst to The Bug Pit.

Continue reading “Mini-Me: Uzbekistan Wants to Join NATO, Conquer Eurasia [We Do Not Make This Stuff Up] — Full Reading [English Below the Line] Makes Clear This Is A Manifesto — From Water to Genocide to Labor to Historical Grievances”

Mini-Me: NSA’s Utah Center Will Use 1.7 Million Gallons of Water Every 24 Hours — Meanwhile, Widespread Water Shortages in Utah

Government, Idiocy, Military
0Shares
Who?  Mini-Me?
Who? Mini-Me?

Huh?

New Utah NSA center requires 1.7M gallons of water daily to operate

More secrets, more water? The NSA data center in Bluffdale could require as many as 1.7 million gallons of water per day to operate and keep computers cool.

Initial reported estimates suggested the center would use 1,200 gallons per minute, but more recent estimates suggest the usage could be closer to half that amount.

“Our planning is anywhere from 1,000 acre-feet per year to 2,000 acre-feet per year, and that represents – if it was 1,000 acre-feet per year, that would be about 1 percent of our total demand,” said Jordan Valley River Conservancy District assistant general manager and chief engineer Alan Packard.

. . . . . . . .

Reid said Bluffdale otherwise wouldn't have had the resources to improve the land all the way to the south end of the city limits. Instead, the government funded $7 million in infrastructure to the data center, and an additional $5 million in infrastructure back from the site that will allow a third of the water used at the facility to be recycled.

The water would be used at the city park and on some of the city's lawns, Reid said.

Reid said the city was now pursuing other technology business to relocate to the south end of Bluffdale.

“We're looking to try and combine with Salt Lake County to make that a jobs area,” Reid said.

Read full article.

Phi Beta Iota:  This is amusing in part because CIA has supposedly been getting a grip on water for the Department of State, and its obvious that NSA does not read CIA reports and does not care about little things like being in the middle of nowhere with vanishing aquifers.

See Also:

Widespread water shortages in Utah could bring fines for misuse

Edutopia: The Future of Just in Time Hand-Held Education

04 Education, 07 Health
0Shares

edutopiaSix Free iPad Apps for Making Healthy Choices

Fooducate lets users scan the barcode of any a processed food item. Each product is given a letter grade based on how healthy that food item is — and provides details to support its claim. This interactive app can be used with almost any food product that can be scanned at a supermarket checkout. Whether you're taking your students on a community field trip or creating a virtual grocery store in your classroom, Fooducate is a great app for sparking conversation. This app is perfect for teaching students how to shop smart, choose healthy foods, and even think about the way products are marketed.

Big Fork Little Fork is a free app that packs a punch. Share tips on cooking, good nutrition and produce, and learn skills that can be used to maintain a healthy lifestyle. This app includes how-to videos and games that explore the food pyramid.

Continue reading “Edutopia: The Future of Just in Time Hand-Held Education”