status.html 10 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256
  1. <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
  2. <html>
  3. <head>
  4. <title>Status &amp; Roadmap</title>
  5. <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
  6. <meta name="Author" content="Mike Pall">
  7. <meta name="Copyright" content="Copyright (C) 2005-2010, Mike Pall">
  8. <meta name="Language" content="en">
  9. <link rel="stylesheet" type="text/css" href="bluequad.css" media="screen">
  10. <link rel="stylesheet" type="text/css" href="bluequad-print.css" media="print">
  11. <style type="text/css">
  12. ul li { padding-bottom: 0.3em; }
  13. </style>
  14. </head>
  15. <body>
  16. <div id="site">
  17. <a href="http://luajit.org"><span>Lua<span id="logo">JIT</span></span></a>
  18. </div>
  19. <div id="head">
  20. <h1>Status &amp; Roadmap</h1>
  21. </div>
  22. <div id="nav">
  23. <ul><li>
  24. <a href="luajit.html">LuaJIT</a>
  25. <ul><li>
  26. <a href="install.html">Installation</a>
  27. </li><li>
  28. <a href="running.html">Running</a>
  29. </li></ul>
  30. </li><li>
  31. <a href="extensions.html">Extensions</a>
  32. <ul><li>
  33. <a href="ext_jit.html">jit.* Library</a>
  34. </li><li>
  35. <a href="ext_c_api.html">Lua/C API</a>
  36. </li></ul>
  37. </li><li>
  38. <a class="current" href="status.html">Status</a>
  39. <ul><li>
  40. <a href="changes.html">Changes</a>
  41. </li></ul>
  42. </li><li>
  43. <a href="faq.html">FAQ</a>
  44. </li><li>
  45. <a href="http://luajit.org/performance.html">Performance <span class="ext">&raquo;</span></a>
  46. </li><li>
  47. <a href="http://luajit.org/download.html">Download <span class="ext">&raquo;</span></a>
  48. </li></ul>
  49. </div>
  50. <div id="main">
  51. <p>
  52. The <span style="color: #0000c0;">LuaJIT 1.x</span> series represents
  53. the current <span style="color: #0000c0;">stable branch</span>.
  54. Only a single bug has been discovered in the last two years. So, if
  55. you need a rock-solid VM, you are encouraged to fetch the latest
  56. release of LuaJIT 1.x from the <a href="http://luajit.org/download.html"><span class="ext">&raquo;</span>&nbsp;Download</a>
  57. page.
  58. </p>
  59. <p>
  60. <span style="color: #c00000;">LuaJIT 2.0</span> is the currently active
  61. <span style="color: #c00000;">development branch</span>.
  62. It has <b>Beta Test</b> status and is still undergoing
  63. substantial changes.
  64. It has <a href="http://luajit.org/performance.html"><span class="ext">&raquo;</span>&nbsp;much better performance</a> than LuaJIT 1.x.
  65. It's maturing quickly, so you should definitely
  66. start to evaluate it for new projects right now.
  67. </p>
  68. <h2>Current Status</h2>
  69. <p>
  70. This is a list of the things you should know about the LuaJIT 2.0 beta test:
  71. </p>
  72. <ul>
  73. <li>
  74. Obviously there will be many <b>bugs</b> in a VM which has been
  75. rewritten from the ground up. Please report your findings together with
  76. the circumstances needed to reproduce the bug. If possible, reduce the
  77. problem down to a simple test case.<br>
  78. There is no formal bug tracker at the moment. The best place for
  79. discussion is the
  80. <a href="http://www.lua.org/lua-l.html"><span class="ext">&raquo;</span>&nbsp;Lua mailing list</a>. Of course
  81. you may also send your bug reports <a href="contact.html">directly to me</a>,
  82. especially when they contain lengthy debug output or if you require
  83. confidentiality.
  84. </li>
  85. <li>
  86. The JIT compiler only generates code for CPUs with support for
  87. <b>SSE2</b> instructions. I.e. you need at least a P4, Core 2/i3/i5/i7,
  88. Atom or K8/K10 to get the full benefit.<br>
  89. If you run LuaJIT on older CPUs without SSE2 support, the JIT compiler
  90. is disabled and the VM falls back to the LuaJIT interpreter. This is faster
  91. than the Lua interpreter, but not nearly as fast as the JIT compiler of course.
  92. Run the command line executable without arguments to show the current status
  93. (<tt>JIT: ON</tt> or <tt>JIT: OFF</tt>).
  94. </li>
  95. <li>
  96. The VM is complete in the sense that it <b>should</b> run all Lua code
  97. just fine. It's considered a serious bug if the VM crashes or produces
  98. unexpected results &mdash; please report this. There are only very few
  99. known incompatibilities with standard Lua:
  100. <ul>
  101. <li>
  102. The Lua <b>debug API</b> is missing a couple of features (return
  103. hooks for non-Lua functions) and shows slightly different behavior
  104. (no per-coroutine hooks, no tail call counting).
  105. </li>
  106. <li>
  107. <b>Bytecode</b> currently cannot be loaded or dumped. Note that
  108. the bytecode format differs from Lua&nbsp;5.1 &mdash; loading foreign
  109. bytecode is not supported at all.
  110. </li>
  111. <li>
  112. Some of the <b>configuration options</b> of Lua&nbsp;5.1 are not supported:
  113. <ul>
  114. <li>The <b>number type</b> cannot be changed (it's always a <tt>double</tt>).</li>
  115. <li>The stand-alone executable cannot be linked with <b>readline</b>
  116. to enable line editing. It's planned to add support for loading it
  117. on-demand.</li>
  118. </ul>
  119. </li>
  120. <li>
  121. Most other issues you're likely to find (e.g. with the existing test
  122. suites) are differences in the <b>implementation-defined</b> behavior.
  123. These either have a good reason (like early tail call resolving which
  124. may cause differences in error reporting), are arbitrary design choices
  125. or are due to quirks in the VM. The latter cases may get fixed if a
  126. demonstrable need is shown.
  127. </li>
  128. </ul>
  129. </li>
  130. <li>
  131. The <b>JIT compiler</b> is not complete (yet) and falls back to the
  132. interpreter in some cases. All of this works transparently, so unless
  133. you use <tt>-jv</tt>, you'll probably never notice (the interpreter is
  134. <a href="http://luajit.org/performance.html"><span class="ext">&raquo;</span>&nbsp;quite fast</a>, too). Here are the known issues:
  135. <ul>
  136. <li>
  137. Most known issues cause a <b>NYI</b> (not yet implemented) trace abort
  138. message. E.g. for calls to some internal library
  139. functions. Reporting these is only mildly useful, except if you have good
  140. example code that shows the problem. Obviously, reports accompanied with
  141. a patch to fix the issue are more than welcome. But please check back
  142. with me, before writing major improvements, to avoid duplication of
  143. effort.
  144. </li>
  145. <li>
  146. The trace compiler currently doesn't back off specialization for
  147. function call dispatch. It should really fall back to specializing on
  148. the prototype, not the closure identity. This can lead to the so-called
  149. "trace explosion" problem with <b>closure-heavy programming</b>. The
  150. trace linking heuristics prevent this, but in the worst case this
  151. means the code always falls back to the interpreter.
  152. </li>
  153. <li>
  154. <b>Trace management</b> needs more tuning: less drastic countermeasures
  155. against trace explosion and better heuristics in general.
  156. </li>
  157. <li>
  158. Some checks are missing in the JIT-compiled code for obscure situations
  159. with <b>open upvalues aliasing</b> one of the SSA slots later on (or
  160. vice versa). Bonus points, if you can find a real world test case for
  161. this.
  162. </li>
  163. <li>
  164. Currently some <b>out-of-memory</b> errors from <b>on-trace code</b> are not
  165. handled correctly. The error may fall through an on-trace
  166. <tt>pcall</tt> (x86) or it may be passed on to the function set with
  167. <tt>lua_atpanic</tt> (x64).
  168. </li>
  169. </ul>
  170. </li>
  171. </ul>
  172. <h2>Roadmap</h2>
  173. <p>
  174. Rather than stating exact release dates (I'm well known for making
  175. spectacularly wrong guesses), this roadmap lists the general project
  176. plan, sorted by priority, as well as ideas for the future:
  177. </p>
  178. <ul>
  179. <li>
  180. The main goal right now is to stabilize LuaJIT 2.0 and get it out of
  181. beta test. <b>Correctness</b> has priority over completeness. This
  182. implies the first stable release will certainly NOT compile every
  183. library function call and will fall back to the interpreter from time
  184. to time. This is perfectly ok, since it still executes all Lua code,
  185. just not at the highest possible speed.
  186. </li>
  187. <li>
  188. The next step is to get it to compile more library functions and handle
  189. more cases where the compiler currently bails out. This doesn't mean it
  190. will compile every corner case. It's much more important that it
  191. performs well in a majority of use cases. Every compiler has to make
  192. these trade-offs &mdash; <b>completeness</b> just cannot be the
  193. overriding goal for a low-footprint, low-overhead JIT compiler.
  194. </li>
  195. <li>
  196. More <b>optimizations</b> will be added in parallel to the last step on
  197. an as-needed basis. Sinking of stores
  198. to aggregates and sinking of allocations are high on the list.
  199. More complex optimizations with less pay-off, such as value-range-propagation
  200. (VRP) will have to wait.
  201. </li>
  202. <li>
  203. LuaJIT 2.0 has been designed with <b>portability</b> in mind.
  204. Nonetheless, it compiles to native code and needs to be adapted to each
  205. architecture. The two major work items are porting the the fast interpreter,
  206. which is written in assembler, and porting the compiler backend.
  207. Most other portability issues like endianess or 32 vs. 64&nbsp;bit CPUs
  208. have already been taken care of.<br>
  209. Several ports are already available, thanks to the
  210. <a href="http://luajit.org/sponsors.html"><span class="ext">&raquo;</span>&nbsp;LuaJIT sponsorship program</a>.
  211. More ports will follow in the future &mdash; companies which are
  212. interested in sponsoring a port to a particular architecture, please
  213. use the given contact address.
  214. </li>
  215. <li>
  216. <b>Documentation</b> about the <b>internals</b> of LuaJIT is still sorely
  217. missing. Although the source code is included and is IMHO well
  218. commented, many basic design decisions are in need of an explanation.
  219. The rather un-traditional compiler architecture and the many highly
  220. optimized data structures are a barrier for outside participation in
  221. the development. Alas, as I've repeatedly stated, I'm better at
  222. writing code than papers and I'm not in need of any academical merits.
  223. Someday I will find the time for it. :-)
  224. </li>
  225. <li>
  226. Producing good code for unbiased branches is a key problem for trace
  227. compilers. This is the main cause for "trace explosion".
  228. <b>Hyperblock scheduling</b> promises to solve this nicely at the
  229. price of a major redesign of the compiler. This would also pave the
  230. way for emitting predicated instructions, which is a prerequisite
  231. for efficient <b>vectorization</b>.
  232. </li>
  233. <li>
  234. Currently Lua is missing a standard library for access to <b>structured
  235. binary data</b> and <b>arrays/buffers</b> holding low-level data types.
  236. Allowing calls to arbitrary C functions (<b>FFI</b>) would obviate the
  237. need to write manual bindings. A variety of Lua extension modules are
  238. available, with different scope and capabilities. Alas, none of them has been
  239. designed with a JIT compiler in mind. An FFI for LuaJIT is currently
  240. in the design phase, but there's no ETA, yet.
  241. </li>
  242. </ul>
  243. <br class="flush">
  244. </div>
  245. <div id="foot">
  246. <hr class="hide">
  247. Copyright &copy; 2005-2010 Mike Pall
  248. <span class="noprint">
  249. &middot;
  250. <a href="contact.html">Contact</a>
  251. </span>
  252. </div>
  253. </body>
  254. </html>