A Critique of the CAP Theorem
Martin Kleppmann
The CAP Theorem is a frequently cited impossibility result in distributed systems, especially among NoSQL distributed databases.
Follow the ideas that keep turning up in Hacker News discussions.
Martin Kleppmann
The CAP Theorem is a frequently cited impossibility result in distributed systems, especially among NoSQL distributed databases.
Heidi Howard, Richard Mortier
Distributed consensus is a fundamental primitive for constructing fault-tolerant, strongly-consistent distributed systems.
Heidi Howard, Dahlia Malkhi, Alexander Spiegelman
Distributed consensus is integral to modern distributed systems.
E. F. Codd
Future users of large data banks must be protected from having to know how the data is organized in the machine (the internal representation).
Ronen Eldan, Yuanzhi Li
Language models (LMs) are powerful tools for natural language processing, but they often struggle to produce coherent and fluent text when they are small.
Rajeev Acharya, Laleh Aghababaie-Beni, Igor Aleiner +246
Quantum error correction provides a path to reach practical quantum computing by combining multiple physical qubits into a logical qubit, where the logical error rate is suppressed exponentially as more qubits are added.
Joseph M. Hellerstein, Peter Alvaro
A key concern in modern distributed systems is to avoid the cost of coordination while maintaining consistent semantics.
Blaise Agüera y Arcas, Jyrki Alakuijala, James Evans +5
The fields of Origin of Life and Artificial Life both question what life is and how it emerges from a distinct set of "pre-life" dynamics.
Austin G. Fowler, Matteo Mariantoni, John M. Martinis +1
This article provides an introduction to surface code quantum computing.
Oriol Vinyals, Quoc Le
Conversational modeling is an important task in natural language understanding and machine intelligence.
Chengzheng Sun, David Sun, Agustina +1
OT (Operational Transformation) was invented for supporting real-time co-editors in the late 1980s and has evolved to become a core technique used in today's working co-editors and adopted in major industrial products.
Martin Kleppmann, Victor B. F. Gomes, Dominic P. Mulligan +1
We introduce OpSets, an executable framework for specifying and reasoning about the semantics of replicated datatypes that provide eventual consistency in a distributed system, and for mechanically verifying algorithms that implement these datatypes.
Jaime Sevilla, C. Jess Riedel
We consider how to forecast progress in the domain of quantum computing.
Ittay Eyal, Emin Gun Sirer
The Bitcoin cryptocurrency records its transactions in a public log called the blockchain.
Gowthami Somepalli, Vasu Singla, Micah Goldblum +2
Cutting-edge diffusion models produce images with high quality and customizability, enabling them to be used for commercial art and graphic design purposes.
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman +1
We present QLoRA, an efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance.
Niklas Muennighoff, Zitong Yang, Weijia Shi +7
Test-time scaling is a promising new approach to language modeling that uses extra test-time compute to improve performance.
Collin Burns, Haotian Ye, Dan Klein +1
Existing techniques for training language models can be misaligned with the truth: if we train models with imitation learning, they may reproduce errors that humans make; if we train them to generate text that humans rate highly, they may output errors that human evaluators can't detect.
Charlie Chen, Sebastian Borgeaud, Geoffrey Irving +3
We present speculative sampling, an algorithm for accelerating transformer decoding by enabling the generation of multiple tokens from each transformer call.
David Sun, Chengzheng Sun, Agustina Ng +1
OT (Operational Transformation) was invented for supporting real-time co-editors in the late 1980s and has evolved to become core techniques widely used in today's working co-editors and adopted in industrial products.
Vitalik Buterin, Diego Hernandez, Thor Kamphefner +6
We present "Gasper," a proof-of-stake-based consensus protocol, which is an idealized version of the proposed Ethereum 2.0 beacon chain.
Jiaxin Huang, Shixiang Shane Gu, Le Hou +4
Large Language Models (LLMs) have achieved excellent performances in various tasks.
Tomas Mikolov, Ilya Sutskever, Kai Chen +2
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships.
Yoav Goldberg, Omer Levy
The word2vec software of Tomas Mikolov and colleagues (https://code.google.com/p/word2vec/ ) has gained a lot of traction lately, and provides state-of-the-art word embeddings.
Quoc V. Le, Tomas Mikolov
Many machine learning algorithms require the input to be represented as a fixed-length feature vector.
Jing Chen, Silvio Micali
A public ledger is a tamperproof sequence of data that can be read and augmented by everyone.
John Preskill
Noisy Intermediate-Scale Quantum (NISQ) technology will be available in the near future.
Philip Daian, Steven Goldfeder, Tyler Kell +5
Blockchains, and specifically smart contracts, have promised to create fair and transparent trading ecosystems.
Harish Dattatraya Dixit, Sneha Pendharkar, Matt Beadon +4
Silent Data Corruption (SDC) can have negative impact on large-scale infrastructure services.
Zhuoran Liu, Leqi Zou, Xuan Zou +8
Building a scalable and real-time recommendation system is vital for many businesses driven by time-sensitive customer feedback, such as short-videos ranking or online ads.