Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
mathstodon.xyz is one of the many independent Mastodon servers you can use to participate in the fediverse.
A Mastodon instance for maths people. We have LaTeX rendering in the web interface!

Administered by:

Server stats:

2.8K
active users

mathstodon.xyz: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#bitnet

1 post1 participant0 posts today
Public
Hacker News

BitNet b1.58 2B4T Technical Report

arxiv.org/abs/2504.12285

#HackerNews #BitNet #b1.58 #2B4T #Technical #Report #arxiv #research #machinelearning #AI

arXiv logo
arXiv.orgBitNet b1.58 2B4T Technical ReportWe introduce BitNet b1.58 2B4T, the first open-source, native 1-bit Large Language Model (LLM) at the 2-billion parameter scale. Trained on a corpus of 4 trillion tokens, the model has been rigorously evaluated across benchmarks covering language understanding, mathematical reasoning, coding proficiency, and conversational ability. Our results demonstrate that BitNet b1.58 2B4T achieves performance on par with leading open-weight, full-precision LLMs of similar size, while offering significant advantages in computational efficiency, including substantially reduced memory footprint, energy consumption, and decoding latency. To facilitate further research and adoption, the model weights are released via Hugging Face along with open-source inference implementations for both GPU and CPU architectures.
Public *
David Weir :v_enby:

Was looking at the source to a very early arXiv paper (arxiv.org/abs/hep-ph/9210243). The PDF is unavailable, for reasons that are obscure ("pre-1996 submission which cannot be processed"). But there's a lot of history in the source code: it looks like it was submitted, as a single file, emailed from BITNET to the arXiv via a gateway. It also uses a now-obscure TeX package phyzzx (ctan.org/tex-archive/obsolete/).

I know I'll sound like a young person when I say this but I'd love to know how that worked in practice and what it was like to be in academia before everyone had access to a TCP/IP internet connection but after internetworked computers were ubiquitous. Sort of like the TV series Halt and Catch Fire but with physicists.

Screenshot of source code to arXiv submission. The visible lines read: %Paper: hep-ph/9210243 %From: <GRADWOHL%UCLAHEP.BITNET@CORNELLC.cit.cornell.edu> %Date: Fri, 16 Oct 92 15:19 PDT %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% % 1.) The file has to be "TeXed", using the macropackage `phyzzx'. % 2.) The 5 figures are available on request. They can be received % through e-mail in form of PS files, or by regular mail. %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %\input phyzzx \hsize 6.5truein \vsize 9.0truein \hoffset 0.2truein \voffset 0.06truein
#arXiv#BITNET#TeX
Public
frdnd

[bitnet HF1BitLLM/Llama3-8B-1.58-100B-tokens -n 128 -t 0]

What is a llm?
Answer: A llm is a type of essay that is written in the form of a question. It is a type of essay that is used to answer a question that is asked by the reader. It is a type of essay that is used to answer a question that is asked by the reader. It is a type of essay that is used to answer a question that is asked by the reader.

Surprisingly fast on CPU but not yet there: github.com/microsoft/BitNet?ta #llm #bitnet

Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.
GitHubGitHub - microsoft/BitNet: Official inference framework for 1-bit LLMsOfficial inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.
Public
awb

Before I could access the Internet, I was on BITNET. For a system based on remote job entry, it was surprisingly useful and fun! LISTSERV originated there and most communication was non-interactive. There still was a way to do messaging and even a chat network existed that inspired IRC. The limitations of BITNET resulted in a lot of creative solutions.
#bitnet #listserv

SearchLive feeds
About