11 Commits

Include renames

Author	SHA1	Message	Date
Paul Gardner-Stephen	13a2d6f6cb	don't tokenise content following a REM statement.	2019-04-27 22:13:20 +09:30
Paul Gardner-Stephen	7831441cac	strip leading spaces from received line before tokenising	2019-04-27 22:09:56 +09:30
Paul Gardner-Stephen	fd46b9314c	speed up line tokeniser for common cases	2019-04-26 23:39:52 +09:30
Paul Gardner-Stephen	fd612be221	replace keywords with correct tokens in tokeniser	2019-04-26 23:31:08 +09:30
Paul Gardner-Stephen	79997c9e0e	implement quote mode when tokenising basic lines	2019-04-26 23:16:54 +09:30
Paul Gardner-Stephen	df55ff6d25	honour length of packed keyword table	2019-04-26 23:10:47 +09:30
Paul Gardner-Stephen	11392d883c	remove debug output from tokeniser	2019-04-26 23:05:14 +09:30
Paul Gardner-Stephen	eedf82f1fd	fix bugs in pack_word and tokenising	2019-04-26 23:01:05 +09:30
Paul Gardner-Stephen	1bb72973fa	implement reporting BASIC errors, continuing work on tokeniser	2019-04-26 22:27:59 +09:30
Paul Gardner-Stephen	428bd8e497	fix advancing in raw string when encountering a non-token during tokenisation	2019-04-26 22:09:16 +09:30
Paul Gardner-Stephen	06c6bd9c20	work on basic tokeniser	2019-04-26 22:02:56 +09:30