package lwt

  1. Overview
  2. Docs

Description

A promise is a value that may become determined in the future.

Lwt provides typed, composable promises. Promises that are resolved by I/O are resolved by Lwt in parallel.

Meanwhile, OCaml code, including code creating and waiting on promises, runs in a single thread by default. This reduces the need for locks or other synchronization primitives. Code can be run in parallel on an opt-in basis.

Published: 25 Mar 2019

README

Lwt   

Lwt is OCaml's concurrent programming library. It provides a single data type: the promise, which is a value that will become determined in the future. Creating a promise spawns a computation. When that computation is I/O, Lwt runs it in parallel with your OCaml code.

OCaml code, including creating and waiting on promises, is run in a single thread by default, so you don't have to worry about locking or preemption. You can detach code to be run in separate threads on an opt-in basis.

Here is a simplistic Lwt program which requests the Google front page, and fails if the request is not completed in five seconds:

let () =
  let request =
    let%lwt addresses = Lwt_unix.getaddrinfo "google.com" "80" [] in
    let google = Lwt_unix.((List.hd addresses).ai_addr) in

    Lwt_io.(with_connection google (fun (incoming, outgoing) ->
      let%lwt () = write outgoing "GET / HTTP/1.1\r\n" in
      let%lwt () = write outgoing "Connection: close\r\n\r\n" in
      let%lwt response = read incoming in
      Lwt.return (Some response)))
  in

  let timeout =
    let%lwt () = Lwt_unix.sleep 5. in
    Lwt.return None
  in

  match Lwt_main.run (Lwt.pick [request; timeout]) with
  | Some response -> print_string response
  | None -> prerr_endline "Request timed out"; exit 1

(* ocamlfind opt -package lwt.unix -package lwt_ppx -linkpkg -o request example.ml
   ./request *)

In the program, functions such as Lwt_io.write create promises. The let%lwt ... in construct is used to wait for a promise to become determined; the code after in is scheduled to run in a "callback." Lwt.pick races promises against each other, and behaves as the first one to complete. Lwt_main.run forces the whole promise-computation network to be executed. All the visible OCaml code is run in a single thread, but Lwt internally uses a combination of worker threads and non-blocking file descriptors to resolve in parallel the promises that do I/O.


Overview

Lwt compiles to native code on Linux, macOS, Windows, and other systems. It's also routinely compiled to JavaScript for the front end and Node, by js_of_ocaml and BuckleScript.

In Lwt,

  • The core library Lwt provides promises...

  • ...and a few pure-OCaml helpers, such as promise-friendly mutexes, condition variables, and mvars.

  • There is a big Unix binding, Lwt_unix that binds almost every Unix system call. A higher-level module Lwt_io provides nice I/O channels.

  • Lwt_process is for subprocess handling.

  • Lwt_preemptive spawns system threads.

  • The PPX syntax allows using all of the above without going crazy!

  • There are also some other helpers, such as Lwt_react for reactive programming. See the table of contents on the linked manual pages!


Installing

  1. Use your system package manager to install a development libev package. It is often called libev-dev or libev-devel.

  2. opam install conf-libev lwt


Documentation

We are currently working on improving the Lwt documentation (drastically; we are rewriting the manual). In the meantime:

  • The current manual can be found here.

  • Mirage has a nicely-written Lwt tutorial.

  • An example of a simple server written in Lwt.

  • Concurrent Programming with Lwt is a nice source of Lwt examples. They are translations of code from the excellent Real World OCaml, but are just as useful if you are not reading the book.

Note: much of the current manual refers to 'a Lwt.t as "lightweight threads" or just "threads." This will be fixed in the new manual. 'a Lwt.t is a promise, and has nothing to do with system or preemptive threads.


Contact

Open an issue, visit Gitter chat, ask in #ocaml, on discuss.ocaml.org, or on Stack Overflow. Please do ask! Even apparently simple questions often end up educating other users, not to mention enlightening the maintainers!

Release announcements are made in /r/ocaml, and on discuss.ocaml.org. Watching the repo for "Releases only" is also an option.


Contributing

  • We maintain easy starter issues. These are thoroughly explained and hyperlinked. We hope that this makes working on Lwt accessible even to relative OCaml beginners :)

  • CONTRIBUTING.md contains tips for working on the code, such as how to check the code out, how review works, etc. There is also a high-level outline of the code base.

  • The overall development plan can be found in the roadmap.

  • Ask us anything, whether it's about working on Lwt, or any question at all about it :)

  • The documentation always needs proofreading and fixes.

  • Despite a lot of progress, Lwt still needs more tests.

  • You are welcome to pick up any other issue, review a PR, add your opinion, etc.

  • Any feedback is welcome, including how to make contributing easier!


Libraries to use with Lwt

Dependencies (6)

  1. seq
  2. result
  3. ocaml >= "4.02.0" & < "4.12"
  4. mmap
  5. dune
  6. cppo build & >= "1.1.0"

Dev Dependencies (2)

  1. ocamlfind dev & >= "1.7.3-1"
  2. bisect_ppx dev & >= "1.3.0"

  1. 0install >= "2.14"
  2. albatross
  3. alcotest-lwt
  4. alcotest-mirage
  5. ambient-context-lwt
  6. amqp-client >= "0.9.0" & < "1.0.2" | >= "1.1.0"
  7. amqp-client-lwt >= "2.0.1"
  8. angstrom-lwt-unix
  9. anthill
  10. anycache-lwt
  11. arakoon < "1.8.6" | >= "1.8.8"
  12. archi-lwt
  13. arp >= "2.3.1"
  14. arp-mirage
  15. awa-lwt
  16. awa-mirage < "0.2.0"
  17. aws-lwt
  18. aws-s3-lwt
  19. awsm-lwt
  20. azure-cosmos-db
  21. baardskeerder
  22. balancer
  23. bap < "1.0.0"
  24. bap-server != "0.2.0"
  25. bimage-lwt
  26. biocaml = "0.4.0"
  27. bistro >= "0.4.0"
  28. brozip
  29. builder
  30. bun >= "0.3.3"
  31. c3
  32. calculon
  33. caldav
  34. camltc = "0.9.5" | >= "0.9.7.0"
  35. canary
  36. capnp-rpc-lwt < "1.2.3"
  37. capnp-rpc-unix >= "0.9.0" & < "1.2.3"
  38. caqti-lwt >= "0.11.0" & < "2.0.1"
  39. carton-git
  40. carton-lwt
  41. cf-lwt
  42. channel
  43. charrua-client >= "1.3.0"
  44. charrua-client-lwt
  45. charrua-client-mirage
  46. charrua-core < "0.3"
  47. charrua-unix >= "0.3" & != "0.10"
  48. cmdtui-lambda-term
  49. coclobas
  50. cohttp-lwt < "6.0.0~alpha2"
  51. cohttp-lwt-jsoo
  52. cohttp-lwt-unix >= "1.1.1"
  53. cohttp-lwt-unix-nossl
  54. cohttp-lwt-unix-ssl
  55. cohttp-mirage
  56. comby
  57. comby-semantic
  58. conan-lwt
  59. conduit-lwt
  60. conduit-lwt-unix
  61. core-lwt >= "0.3.0"
  62. cowabloga >= "0.2.2"
  63. crunch >= "2.0.0"
  64. cstruct-lwt
  65. csv-lwt
  66. csvprovider
  67. ctypes >= "0.15.0" & < "0.21.1"
  68. ctypes-foreign >= "0.21.1"
  69. current_docker < "0.6.4"
  70. current_examples < "0.6.4"
  71. current_git < "0.6.4"
  72. current_github < "0.6.4"
  73. current_gitlab < "0.6.4"
  74. current_ocluster < "0.2"
  75. current_slack < "0.6.4"
  76. current_web < "0.6.4"
  77. DkSDKFFIOCaml_Std
  78. dap
  79. data-encoding < "0.1.1"
  80. datakit
  81. datakit-bridge-github
  82. datakit-bridge-local-git
  83. datakit-ci
  84. datakit-client >= "0.11.0"
  85. datakit-github
  86. datakit-server
  87. devkit >= "0.6"
  88. dht < "0.2.0"
  89. distributed-lwt
  90. dkim-mirage
  91. dlm
  92. dns >= "0.19.1" & < "0.20.1"
  93. dns-cli >= "4.6.3"
  94. dns-forward >= "0.9.0"
  95. dns-forward-lwt-unix
  96. dns-lwt
  97. dnssd
  98. docker_hub
  99. dream
  100. dream-httpaf
  101. dream-pure
  102. dropbox
  103. dune_watch
  104. earlybird < "1.0.0"
  105. elasticsearch-cli >= "0.4"
  106. eris-lwt
  107. ethernet
  108. ez_api
  109. ezcurl-lwt
  110. ezirmin
  111. ezjsonm >= "0.4.2" & < "0.5.0"
  112. ezjsonm-lwt
  113. ezresto
  114. ezresto-directory
  115. faraday-lwt
  116. faraday-lwt-unix >= "0.6.0"
  117. fat-filesystem >= "0.12.0"
  118. fiber-lwt
  119. flowtype >= "0.72.0"
  120. frenetic < "2.0.0"
  121. fswatch_lwt
  122. fuseau-lwt
  123. gamepad
  124. gdb
  125. gdbprofiler >= "0.3"
  126. git != "1.4.3" & != "1.7.2"
  127. git-paf
  128. git-unix = "1.11.1" | >= "3.0.0" & < "3.10.0"
  129. github
  130. github-hooks < "0.2.0" | >= "0.4.0"
  131. github-unix >= "4.4.0"
  132. gitlab-unix
  133. gluten-lwt < "0.4.0"
  134. gluten-lwt-unix < "0.4.0"
  135. gluten-mirage < "0.4.0"
  136. graphql-lwt
  137. gufo
  138. h2-lwt < "0.10.0"
  139. h2-lwt-unix < "0.10.0"
  140. h2-mirage
  141. happy-eyeballs-lwt
  142. happy-eyeballs-mirage
  143. hardcaml < "1.1.0"
  144. hardcaml-examples >= "0.3.0"
  145. hardcaml-framework
  146. hiredis
  147. hl_yaml
  148. horned_worm < "0.3.1"
  149. http-lwt-client
  150. http-multipart-formdata >= "2.0.0" & < "3.0.0"
  151. http2https
  152. httpaf-lwt-unix
  153. hvsock >= "1.0.2"
  154. i3ipc >= "0.1.4"
  155. imaplet-lwt
  156. influxdb-lwt
  157. inotify >= "2.4"
  158. inquire < "0.3.0"
  159. interface-prime-lwt
  160. iocaml < "0.4.6"
  161. iocaml-kernel >= "0.4.3" & < "0.4.6"
  162. iocamljs-kernel
  163. ip2location
  164. ip2locationio
  165. ipv6-multicast-lwt
  166. irc-client-lwt
  167. irc-client-lwt-ssl
  168. irc-client-tls
  169. irmin < "0.9.6" | = "0.9.10" | >= "0.11.0" & < "2.7.0"
  170. irmin-bench < "2.7.0"
  171. irmin-chunk < "2.7.0"
  172. irmin-containers < "2.7.0"
  173. irmin-fs >= "2.3.0" & < "2.7.0"
  174. irmin-git >= "2.3.0" & < "2.7.0"
  175. irmin-graphql >= "2.3.0" & < "2.7.0"
  176. irmin-http >= "2.3.0" & < "2.7.0"
  177. irmin-indexeddb
  178. irmin-layers < "2.7.0"
  179. irmin-mem >= "2.3.0"
  180. irmin-mirage-git >= "2.3.0" & < "2.7.0"
  181. irmin-mirage-graphql >= "2.3.0" & < "2.7.0"
  182. irmin-pack < "2.7.0"
  183. irmin-test >= "2.3.0" & < "2.7.0"
  184. irmin-unix >= "2.3.0" & < "2.7.0"
  185. irmin-watcher >= "0.3.0"
  186. jerboa
  187. jitsu
  188. joolog
  189. jose < "0.9.0"
  190. js_of_ocaml < "2.5"
  191. js_of_ocaml-lwt >= "3.2.0"
  192. jsoo_broadcastchannel
  193. jsoo_router
  194. jsoo_storage
  195. jupyter >= "2.3.0"
  196. jupyter-kernel >= "0.4"
  197. kafka >= "0.3" & < "0.5"
  198. kafka_lwt
  199. kappa-library
  200. ke >= "0.5"
  201. ketrew >= "3.2.0"
  202. kinetic-client < "0.0.3" | >= "0.0.9"
  203. kubecaml
  204. lablqml < "0.6"
  205. lambda-runtime
  206. lambda-term >= "1.13"
  207. launchd
  208. learn-ocaml >= "0.13.0"
  209. learn-ocaml-client >= "0.13.0"
  210. letsencrypt
  211. letsencrypt-app
  212. letsencrypt-dns
  213. libres3
  214. links < "0.9.5"
  215. lru_cache < "v0.16.0"
  216. lwt-binio
  217. lwt-canceler
  218. lwt-dllist
  219. lwt-exit
  220. lwt-parallel >= "1.0.0"
  221. lwt-pipe
  222. lwt-pipeline
  223. lwt-watcher
  224. lwt-zmq < "1.0.0" | >= "2.0.1"
  225. lwt_camlp4
  226. lwt_domain < "0.3.0"
  227. lwt_eio < "0.4"
  228. lwt_glib >= "1.0.1"
  229. lwt_log >= "1.1.0"
  230. lwt_named_threads
  231. lwt_ppx
  232. lwt_ppx_let
  233. lwt_react >= "1.0.1"
  234. lwt_ssl >= "1.0.1"
  235. mariadb < "0.5.1"
  236. markup = "0.7.6"
  237. markup-lwt
  238. mdx
  239. mechaml
  240. metrics-influx
  241. metrics-lwt
  242. metrics-mirage
  243. metrics-unix
  244. mindstorm-lwt
  245. mirage >= "0.4.1" & != "0.6.1" & < "0.8.0" | >= "0.10.0" & < "2.7.0"
  246. mirage-block < "1.0.0" | >= "2.0.0"
  247. mirage-block-ccm
  248. mirage-block-combinators
  249. mirage-block-lwt
  250. mirage-block-ramdisk
  251. mirage-block-solo5
  252. mirage-block-unix < "2.3.0" | = "2.8.2"
  253. mirage-block-xen
  254. mirage-bootvar-solo5 >= "0.2.0"
  255. mirage-bootvar-unix
  256. mirage-bootvar-xen >= "0.4.0"
  257. mirage-channel >= "4.0.0"
  258. mirage-channel-lwt
  259. mirage-clock-freestanding < "3.0.0"
  260. mirage-clock-lwt
  261. mirage-clock-unix >= "1.2.0" & < "3.0.0"
  262. mirage-console >= "2.1.1" & < "2.2.0" | >= "3.0.0"
  263. mirage-console-lwt
  264. mirage-console-solo5 >= "0.2.0"
  265. mirage-console-unix >= "2.2.1"
  266. mirage-console-xen >= "5.0.0"
  267. mirage-console-xen-backend
  268. mirage-console-xen-cli
  269. mirage-crypto-entropy
  270. mirage-crypto-rng >= "0.7.0" & < "0.11.0"
  271. mirage-crypto-rng-lwt
  272. mirage-crypto-rng-mirage >= "0.8.8"
  273. mirage-device >= "2.0.0"
  274. mirage-dns < "3.0.0"
  275. mirage-entropy
  276. mirage-flow >= "1.0.3" & < "1.2.0" | >= "2.0.0"
  277. mirage-flow-combinators
  278. mirage-flow-lwt
  279. mirage-flow-rawlink
  280. mirage-flow-unix
  281. mirage-fs >= "3.0.0"
  282. mirage-fs-lwt
  283. mirage-fs-unix < "1.1.1" | >= "1.3.0"
  284. mirage-http
  285. mirage-http-unix
  286. mirage-http-xen
  287. mirage-kv >= "3.0.0"
  288. mirage-kv-lwt
  289. mirage-kv-unix < "3.0.0"
  290. mirage-logs
  291. mirage-nat < "3.0.0"
  292. mirage-net >= "3.0.1"
  293. mirage-net-fd
  294. mirage-net-lwt
  295. mirage-net-macosx
  296. mirage-net-solo5
  297. mirage-net-unix >= "2.2.0"
  298. mirage-net-xen
  299. mirage-os-shim >= "3.0.0"
  300. mirage-profile
  301. mirage-protocols >= "4.0.0" & < "8.0.0"
  302. mirage-protocols-lwt
  303. mirage-qubes < "0.2" | >= "0.4" & < "0.9.4"
  304. mirage-qubes-ipv4 < "0.9.4"
  305. mirage-random-stdlib >= "0.1.0"
  306. mirage-runtime >= "3.7.0"
  307. mirage-solo5
  308. mirage-stack >= "2.0.0" & < "4.0.0"
  309. mirage-stack-lwt
  310. mirage-time >= "2.0.0"
  311. mirage-time-lwt
  312. mirage-time-unix
  313. mirage-types-lwt < "3.7.1"
  314. mirage-unix >= "3.0.0"
  315. mirage-vnetif
  316. mirage-vnetif-stack
  317. mirage-www >= "1.1.0"
  318. mirage-xen
  319. mirror
  320. moonpool-lwt
  321. mqtt = "0.0.2"
  322. mrmime >= "0.5.0"
  323. multipart-form-data >= "0.2.0"
  324. multipart_form >= "0.2.0" & < "0.4.0"
  325. multipart_form-lwt < "0.6.0"
  326. mwt
  327. named-pipe >= "0.3"
  328. nanomsg
  329. nbd = "2.1.1" | >= "3.0.0"
  330. nbd-tool
  331. nbd-unix
  332. netchannel
  333. nocrypto >= "0.5.4"
  334. noise
  335. nottui-lwt
  336. nproc
  337. nsq >= "0.4.0"
  338. obrowser
  339. obuilder < "0.4"
  340. obus >= "1.1.8" & < "1.2.1"
  341. ocaml-variants >= "4.00.1+mirage-unix" & < "4.00.1+open-types"
  342. ocluster < "0.2"
  343. ocluster-api < "0.2"
  344. ocplib-concur
  345. ocplib-resto
  346. ocsigen-start >= "4.1.0" & < "4.7.0"
  347. ocsigenserver >= "2.10"
  348. ocsipersist
  349. ocsipersist-dbm
  350. ocsipersist-lib
  351. ocsipersist-pgsql
  352. ocsipersist-sqlite
  353. odoc >= "2.0.0" & < "2.1.0"
  354. ojquery
  355. ojs-base < "0.6.0"
  356. opam-compiler < "0.2.0"
  357. opam-publish = "0.3.5"
  358. opam-sync-github-prs
  359. openflow < "0.2.0"
  360. opium >= "0.11.0" & != "0.16.0" & < "0.19.0"
  361. opium_kernel
  362. opomodoro
  363. order-i3-xfce
  364. ordma >= "0.0.3"
  365. osc-lwt
  366. oskel >= "0.3.0"
  367. ounit-lwt < "2.2.0"
  368. ounit2-lwt
  369. owork
  370. ox < "1.1.0"
  371. paf
  372. paf-cohttp
  373. pcap-format >= "0.3.3" & < "0.5.0"
  374. pgx_lwt
  375. pgx_lwt_mirage
  376. pgx_lwt_unix < "2.0"
  377. plotkicadsch >= "0.4.0"
  378. ppx_defer >= "0.4.0"
  379. ppx_deriving_rpc
  380. ppx_json_types
  381. ppx_netblob
  382. ppx_rapper_lwt
  383. ppx_sqlexpr
  384. prof_spacetime
  385. prometheus
  386. prometheus-app
  387. promise_jsoo_lwt
  388. protocol-9p >= "0.10.0"
  389. protocol-9p-unix
  390. qcow >= "0.8.1"
  391. qcow-format < "0.3"
  392. qcow-tool
  393. qfs = "0.5" | >= "0.7"
  394. quests
  395. rawlink >= "1.0" & < "2.1"
  396. rawlink-lwt
  397. redis-lwt
  398. resource-pooling >= "0.3.2"
  399. resp
  400. resp-mirage >= "0.10.0"
  401. resp-unix >= "0.10.0"
  402. resto
  403. resto-cohttp-client
  404. resto-cohttp-self-serving-client
  405. resto-cohttp-server
  406. resto-directory
  407. riak
  408. ringo-lwt
  409. river
  410. rpc >= "1.5.1" & < "7.1.0"
  411. rpclib-js
  412. rpclib-lwt
  413. sanddb
  414. scgi
  415. sendmail-lwt
  416. serial
  417. session-cohttp-lwt
  418. session-cookie-lwt
  419. session-postgresql-lwt >= "0.4.1"
  420. sessions
  421. shared-block-ring < "2.3.0" | >= "3.0.0"
  422. shared-memory-ring >= "1.2.0" & < "2.0.0"
  423. shared-memory-ring-lwt
  424. slacko
  425. socket-daemon < "0.3.0"
  426. spin < "0.6.0"
  427. spotify-web-api < "0.2.1"
  428. sqlexpr = "0.7.1" | >= "0.9.0"
  429. statsd-client
  430. stog >= "0.16.0" & < "0.19.0"
  431. syndic >= "1.4" & < "1.6.0"
  432. tar-format >= "0.4.1"
  433. tar-mirage < "2.2.0"
  434. tar-unix
  435. tcpip >= "3.1.1"
  436. teash
  437. telegraml
  438. tezos-p2p < "8.0" | >= "11.0" & < "13.0"
  439. tezos-stdlib < "9.3"
  440. tezos-stdlib-unix < "9.0"
  441. tftp
  442. themoviedb
  443. tls >= "0.10.1" & < "0.16.0"
  444. tls-lwt < "0.17.4"
  445. tls-mirage
  446. tlstunnel >= "0.2.0"
  447. transmission-rpc
  448. tube >= "4.3.0"
  449. tuntap >= "1.0.0" & < "2.0.0"
  450. typerex-lldb
  451. u2f
  452. uspf
  453. uspf-lwt
  454. utop >= "1.4.0"
  455. uwt >= "0.3.0"
  456. vchan >= "0.9.7" & < "2.0.0" | >= "2.0.3"
  457. vchan-unix
  458. vchan-xen
  459. vercel
  460. vhd-format >= "0.7.0" & < "0.8.0"
  461. vhd-format-lwt >= "0.12.0"
  462. vhd-tool < "0.12.0"
  463. vmnet >= "1.3.2"
  464. vpnkit >= "0.2.0"
  465. vue-jsoo < "0.3"
  466. webauthn
  467. websocket < "2.3"
  468. xe-unikernel-upload
  469. xen-api-client < "0.9.14"
  470. xen-block-driver
  471. xen-evtchn != "1.0.6"
  472. xen-evtchn-unix
  473. xen-gnt >= "2.2.3"
  474. xen-gnt-unix >= "4.0.2"
  475. xenctrl < "0.9.29" | >= "0.9.32"
  476. xenstore >= "1.3.0"
  477. xenstore_transport >= "1.0.0"
  478. xentropyd
  479. yurt < "0.3"
  480. zbar
  481. zmq-lwt

Conflicts (1)

  1. ocaml-variants = "4.02.1+BER"