negotiations. Here we had seen the exact same slides the top executives had presented to our board. I couldn't believe that all this information was thrown out to every employee, as if at Google we occupied an alternate universe of kibbutz-like communalism. Despite the transparency of our accounting, I was troubled by my lack of insight into our business model and our competitive environment. I knew exactly how we were doing financially, but I didn't have a clue about what was going on.
Chapter 3
A World without Form
I WOULD NEVER UNDERSTAND this new world until I was fully grounded in search technology. Craig Silverstein volunteered to school me and a handful of other nontechnical staff with a lunchtime talk he called "Google 7A: Search for non-majors." Craig, a former Stanford grad student with an impish grin and a sense of humor dry to the point of sere, liked to say he was employee 1.5, officially added to the payroll between Larry and Sergey when the company incorporated. Craig also provided our daily bread, wandering the halls on random afternoons wearing a beatific smile and announcing in an interrogatory falsetto, "Breaaddd?" Googlers would scramble from their cubicles to partake of the air-filled, nutrition-free loaf he had just taken from Google's breadmaking machine.
We gathered in the Ping-Pong room, which housed the dark green game table formerly in Susan's garage. The net was down, perhaps knocked over by one of our venture capitalists to clear a place for his laptop during the board meeting the day before. Craig began his lecture as we munched on red licorice and bowls of M&Ms.
"A search engine has three components," he began, writing on the whiteboard beneath a header that read "The Life of a Query."
"First, we have to collect information about what pages exist on the web, which we do through a process called crawling. Our spidering software, which we call Googlebot, jumps from link to link gathering URLs [web addresses] and data on the content that lives at each one. The crawl usually takes about a month, and once it's completed, we have a big bag of stuff that needs to be sorted into a usable list. That's called indexing."
I wrote "crawling" and "indexing" in my lab book and put boxes around them. Next I connected the boxes and turned them into a pair of Ben Franklin–style glasses, with a spider hanging from a thread where the nose would be.
"Once we have an index," Craig continued, "we assign a rank to each page based on its importance with our PageRank algorithm. PageRank is Google's secret sauce."
"Secret sauce?" I leaned forward to learn what we had that was better than all the other search engines that our founders seemed so quick to dismiss.
"PageRank looks at all the pages on the web and assigns a value to them based on who else links to them. The more credible the sites linking to them, the higher the PageRank. That's the first half of the recipe."
I wrote "pageRank" under the Ben Franklin spectacles and drew an oval around it. It looked a little like a clown mouth, so I sketched a skull around it and added some Bozo hair on the sides.
"The second half is how we determine which results are most relevant to the specific query we've received. Most of our competitors look at basic stuff like how many times a word appears on a page. We look at what we know about how sites use that term on their pages. What words appear next to it? Is it in bold type or a different font? How does the term appear in links pointing to those pages? That link analysis is really important. The words in the link pointing to a page are called anchor text."
A chain grew from a corner of my clown's mouth and fell to the bottom of the page, where an anchor suddenly appeared surrounded by grinning fish with barracuda teeth.
"How well we match the query determines our search quality," Craig went on, "which is not an exact science, since evaluating whether a query is a good match is somewhat subjective. If you
Chapter 3
A World without Form
I WOULD NEVER UNDERSTAND this new world until I was fully grounded in search technology. Craig Silverstein volunteered to school me and a handful of other nontechnical staff with a lunchtime talk he called "Google 7A: Search for non-majors." Craig, a former Stanford grad student with an impish grin and a sense of humor dry to the point of sere, liked to say he was employee 1.5, officially added to the payroll between Larry and Sergey when the company incorporated. Craig also provided our daily bread, wandering the halls on random afternoons wearing a beatific smile and announcing in an interrogatory falsetto, "Breaaddd?" Googlers would scramble from their cubicles to partake of the air-filled, nutrition-free loaf he had just taken from Google's breadmaking machine.
We gathered in the Ping-Pong room, which housed the dark green game table formerly in Susan's garage. The net was down, perhaps knocked over by one of our venture capitalists to clear a place for his laptop during the board meeting the day before. Craig began his lecture as we munched on red licorice and bowls of M&Ms.
"A search engine has three components," he began, writing on the whiteboard beneath a header that read "The Life of a Query."
"First, we have to collect information about what pages exist on the web, which we do through a process called crawling. Our spidering software, which we call Googlebot, jumps from link to link gathering URLs [web addresses] and data on the content that lives at each one. The crawl usually takes about a month, and once it's completed, we have a big bag of stuff that needs to be sorted into a usable list. That's called indexing."
I wrote "crawling" and "indexing" in my lab book and put boxes around them. Next I connected the boxes and turned them into a pair of Ben Franklin–style glasses, with a spider hanging from a thread where the nose would be.
"Once we have an index," Craig continued, "we assign a rank to each page based on its importance with our PageRank algorithm. PageRank is Google's secret sauce."
"Secret sauce?" I leaned forward to learn what we had that was better than all the other search engines that our founders seemed so quick to dismiss.
"PageRank looks at all the pages on the web and assigns a value to them based on who else links to them. The more credible the sites linking to them, the higher the PageRank. That's the first half of the recipe."
I wrote "pageRank" under the Ben Franklin spectacles and drew an oval around it. It looked a little like a clown mouth, so I sketched a skull around it and added some Bozo hair on the sides.
"The second half is how we determine which results are most relevant to the specific query we've received. Most of our competitors look at basic stuff like how many times a word appears on a page. We look at what we know about how sites use that term on their pages. What words appear next to it? Is it in bold type or a different font? How does the term appear in links pointing to those pages? That link analysis is really important. The words in the link pointing to a page are called anchor text."
A chain grew from a corner of my clown's mouth and fell to the bottom of the page, where an anchor suddenly appeared surrounded by grinning fish with barracuda teeth.
"How well we match the query determines our search quality," Craig went on, "which is not an exact science, since evaluating whether a query is a good match is somewhat subjective. If you
Similar Books
