Code

Implement basic error recovery#2020

Code

Merged

PieterOlivier merged 91 commits intoerror-recoveryusethesource/rascal:error-recoveryfrom to-token-recovererusethesource/rascal:to-token-recovererCopy head branch name to clipboardSep 23, 2024

+6,150-1,666

Commits

Commits on Mar 30, 2022

• recovered Recoverer from git history

  jurgenvinju

  committed
  9deefa3

• Merge branch 'main' into revive-robust-parsing

  jurgenvinju

  committed
  d1fdf89

Commits on Mar 31, 2022

• fixed imports and whitespace

  jurgenvinju

  committed
  9ae895c

• added documentation

  jurgenvinju

  committed
  4e43070

• renamed recoverer and simplified to whitespace only and all context-free non-terminals

  jurgenvinju

  committed
  ff99ac9

• removed unused javadoc plugin that produced warnings

  jurgenvinju

  committed
  d2a0b66

• fixed compiler warnings

  jurgenvinju

  committed
  d9439a4

• fixed warnings

  jurgenvinju

  committed
  d87b4b8

• fixed warnings

  jurgenvinju

  committed
  4897d88

• added boolean parameter \'robust\' to parsing API

  jurgenvinju

  committed
  5803411

• wired boolean parameter for robustness from Rascal function down to parser implementation

  jurgenvinju

  committed
  3adee6c

• added override

  jurgenvinju

  committed
  7318e8f

Commits on Apr 11, 2022

• minor additions to make recovery work and removed dead code

  jurgenvinju

  committed
  f6e13d8

Commits on Apr 13, 2022

• recovered a missing piece from the recovery code

  jurgenvinju

  committed
  ba0fb43

Commits on Apr 14, 2022

• Debugging error recovery

  Show description for 650224a
  jurgenvinju

  committed
  650224a

Commits on Apr 15, 2022

• added possibility for recovered nodes to start back in time (at earlier input locations)

  jurgenvinju

  committed
  6d5d49b

• fixed off-by-one: error nodes should be scheduled one character ahead because the next parser loop iteration always wants to advance one character

  jurgenvinju

  committed
  78ee76b

• fixed another off-by-one

  jurgenvinju

  committed
  d9f8fc9

• added initial construction of skipped nodes

  jurgenvinju

  committed
  685198d

• gave skipped productions a type such that all trees have a type

  jurgenvinju

  committed
  1d5435b

Commits on Apr 19, 2022

• Merge branch 'main' into revive-robust-parsing

  jurgenvinju

  committed
  50edd09

Commits on Jun 1, 2022

• updated template

  jurgenvinju

  committed
  5265ef0

• bumped rascal-maven-plugin to 0.8.0 to see if we can benefit from optimizations

  jurgenvinju

  committed
  a2162c9

• upgraded to rascal-maven-plugin 0.8.1

  jurgenvinju

  committed
  91fb32b

• [maven-release-plugin] prepare release v0.23.1

  jurgenvinju

  committed
  018826f

• [maven-release-plugin] prepare for next development iteration

  jurgenvinju

  committed
  7b6e8b8

• make sure that (a) BasicIDEServices are registered for the commandline version of Rascal and (b) the edit command is wired to the edit IDEService

  jurgenvinju

  committed
  4aefd52

• basic IDE services can now also browse contents of files which are not in the scheme by copyinhthe contents to a tmp file

  jurgenvinju

  committed
  dde9bd9

Commits on Jun 6, 2024

• Merge branch 'main' into robust-parsing-merge-main

  PieterOlivier

  committed
  6f9b2b9

Commits on Jun 9, 2024

• Merge branch 'main' into revive-robust-parsing

  PieterOlivier

  committed
  d88ac77

Commits on Jun 10, 2024

• Started working on a simple recovery test

  PieterOlivier

  committed
  517df9c

Commits on Jun 17, 2024

• Added 'toString' methods and fixed issue in recoverer.

  Show description for c779820
  PieterOlivier

  committed
  c779820

Commits on Jun 18, 2024

• Added 'allowRecovery` keyword parameter in parsing functions.

  PieterOlivier

  committed
  13ffcef

• Removed 'Reflective' prefix from StackNodeIdDispenser class name

  Show description for b8eb72e
  PieterOlivier

  committed
  b8eb72e

Commits on Jun 27, 2024

• WIP: recovery starting to work

  PieterOlivier

  committed
  f82006c

Commits on Jul 8, 2024

• Merge branch 'main' into robust-parsing/simple-test

  PieterOlivier

  committed
  c8faf66

Commits on Jul 10, 2024

• Added some methods to analyze recovered parse errors in parse trees

  PieterOlivier

  committed
  88cddc3

• Added comment and removed unused import

  PieterOlivier

  committed
  6d19281

• Enabled logging when error recovery is in effect

  PieterOlivier

  committed
  bcd5914

• Made printing of productions more robust (it crashed on 'regular' productions)

  PieterOlivier

  committed
  fb6ffe5

• Added some basic recovery tests

  PieterOlivier

  committed
  27f1afc

Commits on Jul 18, 2024

• Implemented parser datastructure visualization using graphviz

  PieterOlivier

  committed
  15fedbf

• Implemented skipping of remaining characters when top-level production is recovered

  PieterOlivier

  committed
  0eed9a1

• Reinstated end-of-input check before recovering (for now)

  PieterOlivier

  committed
  2b044fd

Commits on Aug 6, 2024

• Minor comment and test changes

  PieterOlivier

  committed
  d5dbe8c

Commits on Aug 8, 2024

• In addition to using whitespace we now also skip until after the last token in the production

  PieterOlivier

  committed
  2246e06

Commits on Aug 19, 2024

• Implemented dynamic last/follow calculations

  PieterOlivier

  committed
  4b11450

Commits on Aug 20, 2024

• Minor cleanup of parser tests and debug support

  PieterOlivier

  committed
  8ef03b4

Commits on Aug 21, 2024

• Implemented error tree fixup (including source locations)

  PieterOlivier

  committed
  7d82f20

• Renamed RecoveryNodeFlattener to SkippedNodeFlattener

  PieterOlivier

  committed
  706662b

Commits on Aug 22, 2024

• Implemented basic error disambiguation

  PieterOlivier

  committed
  7d68129

• Added support for error and skipped productions in vis::Text

  PieterOlivier

  committed
  6b2939c

Commits on Aug 26, 2024

• Look "through" non-terminals when finding end/next matchers

  PieterOlivier

  committed
  ff350ca

• Merge branch 'main' into to-token-recoverer

  PieterOlivier

  committed
  6d3d58d

Commits on Aug 28, 2024

• Miscellaneous cleanup of error recovery code

  PieterOlivier

  committed
  2b6a69f

• Removed unused fields from SkippedNode

  PieterOlivier

  committed
  7ee16aa

• Switched from hardcoding to environment variable for the parser visualization path

  PieterOlivier

  committed
  002e7a6

• Fixed some compiler warnings in the DebugVisualizer

  PieterOlivier

  committed
  238e4c2

• Fixed some compiler warnings

  PieterOlivier

  committed
  704726b

• INtroduced StackNodeVisitor

  PieterOlivier

  committed
  af7b5d5

• Fixed more warnings

  PieterOlivier

  committed
  2d3fbb1

• Madde AbstractStackNode.visit public

  PieterOlivier

  committed
  e95b1aa

• Use visitor pattern instead of instanceof in ToTokenRecoverer

  PieterOlivier

  committed
  c06dc6d

• Renamed DebugVisualizer to ParseStateVisualizer

  PieterOlivier

  committed
  d584dfe

• Generalized AbstractStackNode visitor to be able to return values

  PieterOlivier

  committed
  41ea6e8

• Removed debug print

  PieterOlivier

  committed
  82c156d

• Added license header to files introduced for error recovery

  PieterOlivier

  committed
  c406e2b

• Added license header to more files and fixed years.

  PieterOlivier

  committed
  c884ceb

• Fixed bug when inputURI is missing

  PieterOlivier

  committed
  9dce66d

Commits on Aug 29, 2024

• Fixed issues when location information is missing

  PieterOlivier

  committed
  a139019

• Fixed off-by-one-error

  PieterOlivier

  committed
  150131e

Commits on Sep 1, 2024

• Now looking deep to find error trees in getBestErrorTree

  PieterOlivier

  committed
  5b1561e

• Removed prints

  PieterOlivier

  committed
  23d23b4

• Added 'recovery' tests and introduced artificial failure to see if tests are executed

  PieterOlivier

  committed
  93611fe

• Added recovery tests

  PieterOlivier

  committed
  bd2d1ee

• Worked on error recovery tests

  PieterOlivier

  committed
  dec2b29

Commits on Sep 2, 2024

• Improved comments

  PieterOlivier

  committed
  9abd0bc

• Renamed 'input' field to 'inputUri'.

  PieterOlivier

  committed
  4cf173e

• Removed some obsolete comments

  PieterOlivier

  committed
  bcb2753

Commits on Sep 4, 2024

• Added backwards compatible 'parser' function

  PieterOlivier

  committed
  5a2266b

• Renamed input to inputUri

  PieterOlivier

  committed
  2be0d9b

• Disabled tutor because it requires forward-compatibility of Java code at this point

  PieterOlivier

  committed
  36d4964

Commits on Sep 6, 2024

• Various changes based on an excellent code review by Sung.

  PieterOlivier

  committed
  96fc604

• Layout changes

  PieterOlivier

  committed
  cf16c82

Commits on Sep 17, 2024

• Moved tests, replaced UnicodeConverter with String constructor

  PieterOlivier

  committed
  b94bc02

• Control parser visualization by environment variable

  PieterOlivier

  committed
  9444d21

• Introduced NopDebugListener so we can remove all the if checks

  PieterOlivier

  committed
  2200fdf

Commits on Sep 18, 2024

• Fixed compiler error

  PieterOlivier

  committed
  177e425

• Fixed debugListener NPE

  PieterOlivier

  committed
  377a2e1

• Improved parser datastructure visualization

  PieterOlivier

  committed
  074b5bf

Commits on Sep 23, 2024

• Look through "nullable" productions

  PieterOlivier

  committed
  30b935a