Metric: oracle success (higher is better)
| # | Model↕ | oracle success▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | FOAM-Beam Search | 1 | No | - | - | - |
| 2 | Lily | 0.99 | No | - | - | - |
| 3 | Airbert | 0.99 | No | Airbert: In-domain Pretraining for Vision-and-La... | 2021-08-20 | Code |
| 4 | Global Normalization | 0.99 | No | - | - | - |
| 5 | explore@40 beam-search | 0.99 | No | - | - | - |
| 6 | VLN-Bert | 0.99 | No | Improving Vision-and-Language Navigation with Im... | 2020-04-30 | Code |
| 7 | SERL (Beam_Search) | 0.99 | No | - | - | - |
| 8 | ADad | 0.99 | No | - | - | - |
| 9 | null | 0.99 | No | Learning to Navigate Unseen Environments: Back T... | 2019-04-08 | Code |
| 10 | Self-Aware Co-Grounded Model | 0.97 | No | - | - | - |
| 11 | Reinforced Cross-Modal Matching (optimized for SR; with beam search) | 0.96 | No | - | - | - |
| 12 | null | 0.96 | No | - | - | - |
| 13 | Speaker-Follower | 0.96 | No | - | - | - |
| 14 | Active Exploration (Beam Search) | 0.94 | No | - | - | - |
| 15 | human | 0.9 | No | - | - | - |
| 16 | Tactical Rewind - long | 0.9 | No | Tactical Rewind: Self-Correction via Backtrackin... | 2019-03-06 | Code |
| 17 | BEVBert | 0.81 | No | - | - | - |
| 18 | Self-Supervised Auxiliary Reasoning Tasks (Beam Search) | 0.81 | No | Vision-Language Navigation with Self-Supervised ... | 2019-11-18 | - |
| 19 | GMap | 0.8 | No | - | - | - |
| 20 | Gloabl Normalization pre-explore | 0.8 | No | - | - | - |
| 21 | Lily | 0.79 | No | - | - | - |
| 22 | HOC | 0.79 | No | - | - | - |
| 23 | ReadNet | 0.78 | No | - | - | - |
| 24 | metaexplore | 0.77 | No | - | - | - |
| 25 | sponge | 0.77 | No | - | - | - |
| 26 | lxyict | 0.77 | No | - | - | - |
| 27 | Active Exploration (Pre-explore) | 0.77 | No | - | - | - |
| 28 | DUET+PASTS | 0.76 | No | - | - | - |
| 29 | CVPR22 | 0.76 | No | - | - | - |
| 30 | CMC-AAL2 | 0.76 | No | - | - | - |
| 31 | CMG-AAL | 0.76 | No | - | - | - |
| 32 | Single-run | 0.75 | No | - | - | - |
| 33 | Self-Supervised Auxiliary Reasoning Tasks (Pre-explore) | 0.75 | No | Vision-Language Navigation with Self-Supervised ... | 2019-11-18 | - |
| 34 | VLN-TreeTrans | 0.74 | No | - | - | - |
| 35 | EnvEdit+PT | 0.73 | No | - | - | - |
| 36 | DDL | 0.73 | No | - | - | - |
| 37 | Single-Run, No Pre-Explore | 0.73 | No | - | - | - |
| 38 | VLN-BERT-Aug | 0.73 | No | - | - | - |
| 39 | TD-STP | 0.72 | No | - | - | - |
| 40 | Fortest | 0.72 | No | - | - | - |
| 41 | ESceme Single-run | 0.72 | No | - | - | - |
| 42 | single-run | 0.72 | No | Vision-Language Navigation with Random Environme... | 2021-06-15 | Code |
| 43 | Single-Run | 0.72 | No | - | - | - |
| 44 | HAMT | 0.72 | No | - | - | - |
| 45 | CCC(ssm) | 0.72 | No | - | - | - |
| 46 | GraphBert | 0.72 | No | - | - | - |
| 47 | sliu_team | 0.71 | No | - | - | - |
| 48 | WIN | 0.71 | No | - | - | - |
| 49 | WIN + RecVLN BERT | 0.71 | No | - | - | - |
| 50 | coefficient | 0.71 | No | - | - | - |
| 51 | Greedy, No Pre-explore | 0.71 | No | - | - | - |
| 52 | DDL | 0.71 | No | - | - | - |
| 53 | single-run | 0.71 | No | - | - | - |
| 54 | PANDA-TingLiu | 0.71 | No | - | - | - |
| 55 | single-run | 0.71 | No | - | - | - |
| 56 | SEvol_lzy | 0.71 | No | - | - | - |
| 57 | hellohellohello | 0.71 | No | - | - | - |
| 58 | Single Run | 0.71 | No | - | - | - |
| 59 | bin | 0.7 | No | - | - | - |
| 60 | clin | 0.7 | No | - | - | - |
| 61 | Back Translation with Environmental Dropout (exploring unseen environments before testing) | 0.7 | No | - | - | - |
| 62 | Colab_buaa | 0.7 | No | - | - | - |
| 63 | Geo | 0.7 | No | - | - | - |
| 64 | YBYB | 0.7 | No | - | - | - |
| 65 | Single-Run, No Pre-Explore | 0.7 | No | - | - | - |
| 66 | reg | 0.7 | No | - | - | - |
| 67 | ART | 0.7 | No | - | - | - |
| 68 | binbin | 0.7 | No | - | - | - |
| 69 | SSM | 0.7 | No | - | - | - |
| 70 | Hikari | 0.69 | No | - | - | - |
| 71 | ed | 0.69 | No | - | - | - |
| 72 | zq | 0.69 | No | - | - | - |
| 73 | GBSE | 0.69 | No | - | - | - |
| 74 | liuer | 0.69 | No | - | - | - |
| 75 | single-run | 0.68 | No | - | - | - |
| 76 | MARVAL | 0.67 | No | - | - | - |
| 77 | hellohello | 0.67 | No | - | - | - |
| 78 | homebody | 0.67 | No | - | - | - |
| 79 | SIL-R2 | 0.67 | No | - | - | - |
| 80 | trysth | 0.67 | No | - | - | - |
| 81 | SQANv1, No Pre-explore | 0.67 | No | - | - | - |
| 82 | Envdrop+SEVol+BT | 0.66 | No | - | - | - |
| 83 | a new baseline | 0.66 | No | - | - | - |
| 84 | MM2021 | 0.66 | No | Neighbor-view Enhanced Model for Vision and Lang... | 2021-07-15 | Code |
| 85 | without pre-explore, beam-search | 0.65 | No | - | - | - |
| 86 | CMG-AAL-TCSVT | 0.65 | No | - | - | - |
| 87 | Single-Run, No Pre-Explore | 0.65 | No | - | - | - |
| 88 | test-sf | 0.65 | No | - | - | - |
| 89 | OAG(without pre-explore, beam-search) | 0.65 | No | - | - | - |
| 90 | SEA features + AuxRN (single-run) | 0.64 | No | - | - | - |
| 91 | PREVALENT | 0.64 | No | - | - | - |
| 92 | Tactical Rewind - short | 0.64 | No | Tactical Rewind: Self-Correction via Backtrackin... | 2019-03-06 | Code |
| 93 | single run | 0.64 | No | - | - | - |
| 94 | map1 | 0.64 | No | - | - | - |
| 95 | Greedy | 0.63 | No | - | - | - |
| 96 | jmebs | 0.63 | No | - | - | - |
| 97 | SEA features + Env-Dropout (single-run) | 0.63 | No | - | - | - |
| 98 | WQ_Pretrain | 0.63 | No | - | - | - |
| 99 | reward-vln | 0.62 | No | - | - | - |
| 100 | Single-Run | 0.62 | No | - | - | - |
| 101 | 27k | 0.62 | No | - | - | - |
| 102 | Lang-Vis-Entity VLN (Single-Run) | 0.61 | No | - | - | - |
| 103 | DCMT | 0.61 | No | - | - | - |
| 104 | PREVALENT | 0.61 | No | - | - | - |
| 105 | GVLN | 0.61 | No | - | - | - |
| 106 | SERL | 0.61 | No | - | - | - |
| 107 | 2m-path | 0.61 | No | - | - | - |
| 108 | no | 0.61 | No | - | - | - |
| 109 | SYSU-ISE | 0.6 | No | - | - | - |
| 110 | licr19 | 0.6 | No | - | - | - |
| 111 | single-run | 0.59 | No | Vision-Language Navigation with Random Environme... | 2021-06-15 | Code |
| 112 | Back Translation with Environmental Dropout (no beam search) | 0.59 | No | Learning to Navigate Unseen Environments: Back T... | 2019-04-08 | Code |
| 113 | Self-Monitoring Navigation Agent (no beam search; Progress Inference) | 0.59 | No | Self-Monitoring Navigation Agent via Auxiliary P... | 2019-01-10 | Code |
| 114 | SERL (no_augmented) | 0.57 | No | - | - | - |
| 115 | Single-Run, No Pre-Explore | 0.57 | No | - | - | - |
| 116 | testliu | 0.57 | No | - | - | - |
| 117 | selfmoni0 | 0.57 | No | - | - | - |
| 118 | DoubleAttn | 0.57 | No | - | - | - |
| 119 | The Regretful Agent (no beam search; greedy action selection) | 0.56 | No | The Regretful Agent: Heuristic-Aided Navigation ... | 2019-03-05 | Code |
| 120 | ALTR | 0.56 | No | Transferable Representation Learning in Vision-a... | 2019-08-09 | - |
| 121 | Environment-Agnostic Multitask Learning | 0.56 | No | Environment-agnostic Multitask Learning for Natu... | 2020-03-01 | Code |
| 122 | SEA features + Speaker-Follower (single-run) | 0.55 | No | - | - | - |
| 123 | naive | 0.53 | No | - | - | - |
| 124 | speaker_follower_tesk2 | 0.53 | No | - | - | - |
| 125 | Reinforced Cross-Modal Matching (single trajectory; NO beam search) | 0.5 | No | - | - | - |
| 126 | 1111 | 0.49 | No | - | - | - |
| 127 | PTA | 0.47 | No | - | - | - |
| 128 | HAIL | 0.46 | No | - | - | - |
| 129 | Khanh Nguyen | 0.45 | No | - | - | - |
| 130 | Dynamic Convolutional Filters | 0.45 | No | - | - | - |
| 131 | rcm_test | 0.44 | No | - | - | - |
| 132 | ai like samurai with PNasNet5Large | 0.43 | No | - | - | - |
| 133 | base_1 | 0.43 | No | - | - | - |
| 134 | AnonymousTeam | 0.41 | No | - | - | - |
| 135 | fuse_1 | 0.4 | No | - | - | - |
| 136 | base_0 | 0.4 | No | - | - | - |
| 137 | test_an | 0.34 | No | - | - | - |
| 138 | Look Before You Leap | 0.32 | No | - | - | - |
| 139 | X-Modal | 0.32 | No | - | - | - |
| 140 | Seq2Seq Baseline | 0.27 | No | - | - | - |
| 141 | zhangyong | 0.26 | No | - | - | - |
| 142 | zy123 | 0.24 | No | - | - | - |
| 143 | zzzzzzzz55768 | 0.19 | No | - | - | - |
| 144 | Random Agent | 0.18 | No | - | - | - |
| 145 | 15458 | 0 | No | - | - | - |