Ravi Pandya
ravi@iecommerce.com
www.iecommerce.com
+1 425 417 4180
vcard

syndicate this site

Ravi Pandya   software | nanotechnology | economics

ARCHIVES

2007 11 10

2004 10 09 08 07 06

2003 04 02 01

2002 12 11 10 09 08

2001 11

ABOUT ME

Ravi Pandya
Architect
Cloud Computing Futures
Microsoft
ravip at microsoft.com

03-Microsoft
00-02 Covalent
97-00 EverythingOffice
96-97 Jango
93-96 NetManage
89-93 Xanadu
88-89 Hypercube
84,85 Xerox PARC
83-89 University of Toronto, Math
86-87 George Brown College, Dance
95-Foresight Institute
97-Institute for Molecular Manufacturing

DISCLAIMER

The opinions expressed here are purely my own, and do not reflect the policy of my employer.


Sun 03 Oct 2010

Large-scale Incremental Processing Using Distributed Transactions and Notifications - Peng Dabek

http://research.google.com/pubs/archive/36726.pdf
This is a description of the "Percolator" technology behind Google's new incremental "Caffeine" search index. It produces ~100x lower latency than the previous MapReduce-based system, at about a 2x cost in resources. It's a system for dependency propagation using observers on BigTable columns. It also leverages BigTable transactional semantics to provide snapshot isolation and other transaction management services like straggler elimination.

07:42 #


© 2002-2004 Ravi Pandya | All Rights Reserved