All Entities

Model	Embeddings	Gazetteer	Affixes	Epoch	VALID						TEST
					LEGAL	PER	LOC	ORG	TIME	MACRO AVG	LEGAL	PER	LOC	ORG	TIME	MACRO AVG
					F1	F1	F1	F1	F1	F1	F1	F1	F1	F1	F1	F1
NeuroNER Extended	CoRoLa	-	-	13	84.58	81.75	76.11	80.07	84.12	81.37	90.50	95.56	70.59	76.26	85.93	83.90
NeuroNER Extended	CoRoLa	TRUE	-	14	84.88	80.67	76.73	80.11	83.72	81.26	90.06	98.08	75.37	78.38	82.42	85.03
NeuroNER Extended	CoRoLa	TRUE	TRUE	13	83.72	83.00	74.10	80.15	84.21	81.09	89.80	95.56	73.33	75.80	84.53	83.94
NeuroNER Extended	MARCELL	-	-	21	85.79	82.87	75.15	82.56	79.91	81.29	90.41	97.38	70.30	76.70	81.64	83.49
NeuroNER Extended	MARCELL	TRUE	-	13	82.75	78.88	77.44	82.95	85.65	81.56	86.98	98.48	75.94	80.60	84.09	85.34
NeuroNER Extended	MARCELL	TRUE	TRUE	13	86.12	81.30	73.58	81.10	82.48	80.97	90.12	96.65	69.77	74.23	85.55	83.39
NeuroNER Extended	CoRoLa+MARCELL	-	-	10	84.51	77.42	74.78	80.54	84.30	80.32	88.18	98.50	75.62	76.65	84.39	84.74
NeuroNER Extended	CoRoLa+MARCELL	TRUE	-	22	85.61	79.52	71.78	80.86	83.76	80.33	89.68	97.04	75.21	78.69	83.08	84.83
NeuroNER Extended	CoRoLa+MARCELL	TRUE	TRUE	10	83.84	77.11	77.58	80.78	81.78	80.24	89.42	96.99	70.03	79.10	80.54	83.40
NeuroNER Extended	CC	-	-	10	84.88	78.60	72.73	75.46	80.08	78.59	87.04	95.72	74.20	76.41	84.34	83.55
NeuroNER Extended	CC	TRUE	-	7	85.12	77.68	74.92	75.67	80.09	78.90	86.60	95.35	75.08	78.58	85.45	84.28
NeuroNER Extended	CC	TRUE	TRUE	8	84.43	77.33	70.59	76.19	77.67	77.30	87.63	96.12	73.85	75.14	80.08	82.78
NeuroNER Extended	Spacy	-	-	3	84.90	78.15	74.92	80.39	80.98	79.90	88.14	97.74	76.66	77.02	85.93	85.16
NeuroNER Extended	Spacy	TRUE	-	6	84.46	75.10	67.23	77.14	82.96	77.44	89.73	97.76	72.30	78.37	84.92	84.74
NeuroNER Extended	Spacy	TRUE	TRUE	8	83.98	73.47	64.45	65.74	83.98	74.56	89.44	96.68	67.14	70.32	84.49	81.92

PER, LOC, ORG, TIME (No LEGAL)

System	Embeddings	Gazetteer	Affixes	Epoch	VALID					TEST
					PER	LOC	ORG	TIME	MACRO AVG	PER	LOC	ORG	TIME	MACRO AVG
					F1	F1	F1	F1	F1	F1	F1	F1	F1	F1
NeuroNER Extended	CoRoLa	-	-	11	80.50	73.65	87.17	82.68	81.17	96.27	66.86	80.34	89.81	83.35
NeuroNER Extended	CoRoLa	TRUE	-	8	80.63	78.92	85.96	83.07	82.21	96.65	72.13	81.36	88.31	84.64
NeuroNER Extended	CoRoLa	TRUE	TRUE	8	79.01	75.00	85.81	84.15	81.18	97.69	69.54	80.09	89.06	84.10
NeuroNER Extended	MARCELL	-	-	13	81.75	73.58	86.17	83.51	81.57	96.68	74.01	81.24	91.65	85.94
NeuroNER Extended	MARCELL	TRUE	-	9	79.35	75.53	85.47	85.45	81.78	98.86	69.83	79.85	91.93	85.14
NeuroNER Extended	MARCELL	TRUE	TRUE	16	80.65	71.97	86.40	83.94	81.10	96.68	74.49	78.87	92.18	85.66
NeuroNER Extended	CoRoLa+MARCELL	-	-	7	77.05	75.76	85.89	84.59	81.04	98.86	69.59	82.13	90.51	85.29
NeuroNER Extended	CoRoLa+MARCELL	TRUE	-	24	81.12	73.23	85.48	83.69	81.13	97.40	72.88	80.89	90.28	85.39
NeuroNER Extended	CoRoLa+MARCELL	TRUE	TRUE	11	76.54	75.29	85.99	85.12	81.05	98.86	76.01	80.89	91.39	86.84
NeuroNER Extended	CC	-	-	9	73.30	72.49	81.82	85.28	78.85	97.30	74.64	80.67	91.67	86.10
NeuroNER Extended	CC	TRUE	-	7	72.38	75.31	81.49	84.36	79.25	93.65	77.06	80.00	90.74	85.41
NeuroNER Extended	CC	TRUE	TRUE	12	78.11	73.05	82.03	84.95	79.88	96.58	78.29	79.85	91.62	86.59