bert/modeling.py
Line 853 in eedf571
| | attention_output=tf.concat(attention_heads, axis=-1) |
This line of code does not seem to be executed, and may still be wrong. In each loop, attention_heads is an empty list after executing the code on line 831, so the list will only have one element at most, so maybe it should be placed outside line 826.