Frey Microwave Hearing - Beam Voices Into Your Auditory Cortex

TedTalk Talks a Little About Classified Technology

'Smart Dust' Aims To Monitor Everything

By John D. Sutter, CNN (2010)


Palo Alto, California (CNN) -- In the 1990s, a researcher named Kris Pister dreamed up a wild future in which people would sprinkle the Earth with countless tiny sensors, no larger than grains of rice.

These "smart dust" particles, as he called them, would monitor everything, acting like electronic nerve endings for the planet. Fitted with computing power, sensing equipment, wireless radios and long battery life, the smart dust would make observations and relay mountains of real-time data about people, cities and the natural environment.

Now, a version of Pister's smart dust fantasy is starting to become reality. "It's exciting. It's been a long time coming," said Pister, a computing professor at the University of California, Berkeley.

"I coined the phrase 14 years ago. So smart dust has taken a while, but it's finally here."

Maybe not exactly how he envisioned it. But there has been progress.

The latest news comes from the computer and printing company Hewlett-Packard, which recently announced it's working on a project it calls the "Central Nervous System for the Earth." In coming years, the company plans to deploy a trillion sensors all over the planet.

The wireless devices would check to see if ecosystems are healthy, detect earthquakes more rapidly, predict traffic patterns and monitor energy use. The idea is that accidents could be prevented and energy could be saved if people knew more about the world in real time, instead of when workers check on these issues only occasionally.

HP will take its first step toward this goal in about two years, said Pete Hartwell, a senior researcher at HP Labs in Palo Alto. The company has made plans with Royal Dutch Shell to install 1 million matchbook-size monitors to aid in oil exploration by measuring rock vibrations and movement, he said. Those sensors, which already have been developed, will cover a 6-square-mile area.

That will be the largest smart dust deployment to date, he said.

"We just think now, the technology has reached a point where it makes basic sense for us ... to get this out of the lab and into reality," Hartwell said.

Smart dust (minus the 'dust')

Despite the recent excitement, there's still much confusion in the computing industry about what exactly smart dust is.

For starters, the sensors being deployed and developed today are much larger and clunkier than flecks of dust. HP's sensors -- accelerometers like those in the iPhone and Droid phone, but about 1,000 times more powerful -- are about the size of matchbooks. When they're enclosed in a metal box for protection, they're about the size of a VHS tape.

So what makes a smart dust sensor different from a weather station or a traffic monitor?

Size is one factor. Smart dust sensors must be relatively small and portable. But technology hasn't advanced far enough to manufacture the sensors on the scale of millimeters for commercial use (although Berkeley researchers are trying to make one that's a cubic millimeter).

Wireless connections are a big distinguisher, too. A building's thermostat is most likely hard-wired. A smart dust sensor might gauge temperature, but it would be battery-powered and would communicate wirelessly with the internet and with other sensors.

The sheer number of sensors in the network is what truly makes a smart dust project different from other efforts to record data about the world, said Deborah Estrin, a professor of computer science at the University of California, Los Angeles, who works in the field. Smart dust researchers tend to talk in the millions, billions and trillions.

Some say reality has diverged so far from the smart dust concept that it's time to dump that term in favor or something less sexy. "Wireless sensor networks" or "meshes" are terms finding greater acceptance with some researchers.

Estrin said it's important to ditch the idea that smart dust sensors would be disposable.

Sensors have to be designed for specific purposes and spread out on the land intentionally -- not scattered in the wind, as smart dust was initially pitched, she said.

'Real-world web'

Despite these differences, researchers say the smart-dust theory that monitoring everything will benefit humanity remains essentially unchanged.

And there are a number of real-world projects that, in one way or another, seek to use wireless sensors to take the Earth's vital signs.

Wireless sensors currently monitor farms, factories, data centers and bridges to promote efficiency and understanding of how these systems work, researchers said in interviews. In all of these cases, the sensor networks are deployed for a specific purpose.

For example, a company called Streetline has installed 12,000 sensors on parking spots and highways in San Francisco. The sensors don't know everything that's going on at those parking spots. They are equipped with magnetometers to sense whether or not a huge metal object -- hopefully a car -- is sitting on the spot. That data will soon be available to people who can use it to figure out where to park, said Tod Dykstra, Streetline's CEO. It also tells the cities if the meters have expired.

Other sensors are equipped to measure vibration in factories and oil refineries to spot machine problems and inefficiencies before they cause trouble. Still others might pick up data about temperature, chemistry or sound. Tiny cameras or radars also can be tacked onto the data-collecting network to detect the presence of people or vehicles. The power of these networks is that they eventually can be connected, said David Culler, a computer science professor at UC Berkeley.

Culler says the development of these wireless sensor networks is analogous to the creation of the World Wide Web. What's being created with the smart dust idea is a "Real World Web," he said.

But he said we're still early on in that progression. "Netscape [for the wireless sensor network] hasn't quite happened," he said.

Big Brother effect

Even when deployed for science or the public, some people still get a Big Brother feeling -- the uncomfortable sense of being under constant, secret surveillance -- from the idea of putting trillions of monitors all over the world.

"It's a very, very, very huge potential privacy invasion because we're talking about very, very small sensors that can be undetectable, effectively," said Lee Tien, an attorney at the Electronic Frontier Foundation, a privacy advocate. "They are there in such numbers that you really can't do anything about them in terms of easy countermeasures."

That doesn't mean that researchers should stop working on smart dust. But they should be mindful of privacy as the work progresses, he said. Pister said the wireless frequencies that smart dust sensors use to communicate -- which work kind of like Wi-Fi -- have security built into them. So the data is public only if the person or company that installed the sensor wants it to be, he said.

"Clearly, there are security concerns and privacy concerns," he said, "and the good news is that when the radio technology was being developed for this stuff, it was shortly after all of the big concerns about Wi-Fi security. ... We've got all the security tools we need underneath to make this information private."

Further privacy concerns may arise if another vision for smart dust comes true. Some researchers are looking into making mobile phones into sensors. In this scenario, the billions of people roaming the Earth with cell phones become the "smart dust."

Bright future

Smart dust researchers say their theory of monitoring the world -- however it's realized -- will benefit people and the environment. More information is better information, Pister said. "Having more sensors improves the efficiency of a system and reduces the demand and reduces waste," he said. "So all of that is just straight goodness."

Hartwell, the HP researcher, says the only way people can combat huge problems like climate change and biodiversity loss is to have more information about what's going on. "Frankly, I think we have to do it, from a sustainability and environmental standpoint," he said. Even though the first application of HP's "Central Nervous System for the Earth" project will be commercial, Hartwell says the motives behind smart dust are altruistic.

"People ask me what my job is, and I say, well, I'm going to save the world," he said.

More About Transhumanism & Hooking Your Brain Up To a Computer

Genetically Engineered 'Magneto' Protein Remotely Controls Brain and Behavior

 Click Here to Read the Full Article

IBM Builds A Scalable Computer Chip Inspired By The Human Brain

By Alex Knapp


"I’m holding in my hand a chip with one million neurons, 256 million synapses, and 4096 cores. With 5.4 billion transistors, it's the largest chip IBM has built."

Dr. Dharmendra S. Modha sounds positively giddy as he talks to me on the phone. This is the third time I've talked to him about his long-term project - an IBM project with the goal of creating an entirely new type of computer chip, SyNAPSE, whose architecture is inspired by the human brain. This new chip is a major success in that project.

"Inspired" is the key word, though. The chip's architecture is based on the structure of our brains, but very simplified. Still, within that architecture lies some amazing advantages over computers today. For one thing, despite this being IBM's largest chip, it draws only a tiny amount of electricity - about 63 mW - a fraction of the power being drawn by the chip in your laptop.

What's more, the new chip is also scalable - making possible larger neural networks of several chips connected together. The details behind their research has been published today in Science.

"In 2011, we had a chip with one core," Modha told me. "We have now scaled that to 4096 cores, while shrinking each core 15x by area and 100x by power."

Each core of the chip is modeled on a simplified version of the brain's neural architecture. The core contains 256 “neurons” (processors), 256 “axons” (memory) and 64,000 “synapses” (communications between neurons and axons). This structure is a radical departure from the von Neumann architecture that's the basis of virtually every computer today (including the one you're reading this on.)

Work on this project began in 2008 in a collaboration between IBM and several universities over the years. The project has received $53 million in funding from the Defense Advanced Research Projects Agency (DARPA). The first prototype chip was developed in 2011, and a programming language and development kit was released in 2013.

"This new chip will provide a powerful tool to researchers who are studying algorithms that use spiking neurons," Dr. Terrence J. Sejnowski told me. Sejnowski heads Computational Neurobiology Laboratory at the Salk Institute. He's unaffiliated with IBM's project but is familiar with the technology. "We know that such algorithms exist because the brain uses spiking neurons and can outperform all existing approaches, with a power budget of 20 watts, less than your laptop."

It's important to note, though, that the SyNAPSE system won't replace the computers of today - rather, they're intended to supplement them. Modha likened them to co-processors used in high performance computers to help them crunch data faster. Or, in a more poetic turn as he continued talking to me, he called SyNAPSE a "right-brained" computer compared to the "left-brained" architecture used in computers today.

"Current von Neumann machines are fast, symbolic, number-crunchers," he said. "SyNAPSE is slow, multi-sensory, and better at recognizing sensor data in real-time."

So to crunch big numbers and do heavy computational lifting, we'll still need conventional computers. Where these "cognitive" computers come in is in analyzing and discerning patterns in that data. Key applications include visual recognition of patterns - something that Dr. Modha notes would be very useful for applications such as driverless cars.

As Sejnowski told me, "The future is finding a path to low power computing that solves problems in sensing and moving -- what we do so well and digital computers do so awkwardly."

And that's what IBM is looking to do with SyNAPSE - finding the patterns that normal computers can't. As Modha put it, "Google Maps can plot your route, but SyNAPSE can see if there's a pothole."

What gives the SyNAPSE an advantage in pattern recognition is that, unlike a traditional computer, which crunches data sequentially, its brain-inspired architecture allows for more parallel processing. For example, in a facial recognition app, one core of the chip might be focused on nose shape, one on hair texture and color, one on eye color, etc. Each individual core is slower than a traditional processor, but since they run simultaneously in parallel, the chip as a whole can perform this type of operation much more quickly and accurately.

Other potential applications for the chip include use in cameras to automatically identify interesting items in cluttered environments. Modha's team also believes that the chip could be quite useful in natural language processing - being able to parse out and obey commands from people. Kind of like the computers on Star Trek that understood when they were in use and when people were just talking among themselves.

It probably won't be long before we see more of these applications in action. The scalable chip that IBM developed was built using conventional fabrication techniques for other chips - it just requires some different workflow.

Already over 200 programs have been developed for the chip, thanks to a simulation of the architecture running on supercomputers at at the Lawrence Livermore and Lawrence Berkeley National Laboratories. Those simulations allowed IBM to develop a programming language for the chip even before it existed.

"We've been working with IBM for the last 18 months and are extremely impressed with their achievement," Prof. Tobi Delbruck of the Institute of Neuroinformatics at UZH-ETH Zurich told me. "Applications like real time speech and vision that run continuously on battery power may finally be within reach."

"It's too soon to say who will win the race to implement practical realizations of brain-like computing in silicon," Delbruck added. "but IBM's solution is a serious contender."

Now that this new chip architecture has been developed and a fabrication technique setup, Modha said that the technology now is "like the 4 minute mile. Now that someone's done it, a lot of people can do it."

To help facilitate the development of the chip, both on the hardware and software side, IBM has developed a teaching curriculum for universities, its customers, its employees, and more.

On the hardware end, Modha's next goal is the development of what he calls a "neurosynaptic supercomputer." This would be a traditional supercomputer that uses both traditional and SyNAPSE chips - a computer with both a left and right brain, as it were - enabling it both to crunch numbers and quickly analyze real-time patterns as the data's crunched.

One question that Modha couldn't answer, though, what what the new chip means for video games - nobody's programmed one for SyNAPSE yet.
"That's an interesting question," he laughed. "But we're too busy for games!"

IBM Develops a New Chip That Functions Like a Brain

By John Markoff


Inspired by the architecture of the brain, scientists have developed a new kind of computer chip that uses no more power than a hearing aid and may eventually excel at calculations that stump today’s supercomputers.

The chip, or processor, is named TrueNorth and was developed by researchers at IBM and detailed in an article published on Thursday in the journal Science. It tries to mimic the way brains recognize patterns, relying on densely interconnected webs of transistors similar to the brain’s neural networks.

The chip’s electronic “neurons” are able to signal others when a type of data — light, for example — passes a certain threshold. Working in parallel, the neurons begin to organize the data into patterns suggesting the light is growing brighter, or changing color or shape.

The processor may thus be able to recognize that a woman in a video is picking up a purse, or control a robot that is reaching into a pocket and pulling out a quarter. Humans are able to recognize these acts without conscious thought, yet today’s computers and robots struggle to interpret them.

The chip contains 5.4 billion transistors, yet draws just 70 milliwatts of power. By contrast, modern Intel processors in today’s personal computers and data centers may have 1.4 billion transistors and consume far more power — 35 to 140 watts.

Today’s conventional microprocessors and graphics processors are capable of performing billions of mathematical operations a second, yet the new chip system clock makes its calculations barely a thousand times a second. But because of the vast number of circuits working in parallel, it is still capable of performing 46 billion operations a second per watt of energy consumed, according to IBM researchers.

The TrueNorth has one million “neurons,” about as complex as the brain of a bee.

“It is a remarkable achievement in terms of scalability and low power consumption,” said Horst Simon, deputy director of the Lawrence Berkeley National Laboratory.

He compared the new design to the advent of parallel supercomputers in the 1980s, which he recalled was like moving from a two-lane road to a superhighway.

The new approach to design, referred to variously as neuromorphic or cognitive computing, is still in its infancy, and the IBM chips are not yet commercially available. Yet the design has touched off a vigorous debate over the best approach to speeding up the neural networks increasingly used in computing.

Photo
A silicon chip relies on webs of transistors similar to the brain’s neural networks. Credit I.B.M.

The idea that neural networks might be useful in processing information occurred to engineers in the 1940s, before the invention of modern computers. Only recently, as computing has grown enormously in memory capacity and processing speed, have they proved to be powerful computing tools.

In recent years, companies including Google, Microsoft and Apple have turned to pattern recognition driven by neural networks to vastly improve the quality of services like speech recognition and photo classification.

But Yann LeCun, director of artificial intelligence research at Facebook and a pioneering expert in neural networks, said he was skeptical that IBM’s approach would ever outpace today’s fastest commercial processors.

“The chip appears to be very limited in many ways, and the performance is not what it seems,” Mr. LeCun wrote in an email sent to journalists. In particular, he criticized as inadequate the testing of the chip’s ability to detect moving pedestrians and cars.

“This particular task,” he wrote, “won’t impress anyone in computer vision or machine learning.” Mr. LeCun said that while special-purpose chips running neural networks might be useful for a range of applications, he remained skeptical about the design IBM has chosen.

Several neuroscience researchers and computer scientists disputed his critique.

“The TrueNorth chip is like the first transistor,” said Terrence J. Sejnowski, director of the Salk Institute’s Computational Neurobiology Laboratory. “It will take many generations before it can compete, but when it does, it will be a scalable architecture that can be delivered to cellphones, something that Yann’s G.P.U.s will never be able to do.”

G.P.U. refers to graphics processing unit, the type of chip being used today to deliver graphics and video to computer screens and for special processing tasks in supercomputers.

IBM’s research was funded by the Defense Advanced Research Projects Agency, a research arm of the Pentagon, under a program called Systems of Neuromorphic Adaptive Plastic Scalable Electronics, or SyNapse. According to Gill Pratt, the program manager, the agency is pursuing twin goals in its effort to design ultralow-power biological processors.

The first, Dr. Pratt said, is to automate some of the surveillance done by military drones. “We have lots of data and not enough people to look at them,” he said.

The second is to create a new kind of laboratory instrument to allow neuroscientists to quickly test new theories about how brains function.

Correction: August 7, 2014

Because of an editing error, an earlier version of this article misstated the day on which the report of a new computer chip was published. It was Thursday, not Wednesday.

Correction: August 11, 2014

An article on Friday about a new IBM computer chip that is said to mimic the way a human brain works omitted the last word in the name of a program known by the acronym SyNapse, which funded IBM’s research. It is Systems of Neuromorphic Adaptive Plastic Scalable Electronics.