All Entities

Model	Embeddings	Gazetteer	Affixes	Epoch	TRAIN																		VALID																		TEST
					LEGAL			PER			LOC			ORG			TIME			MACRO AVG			LEGAL			PER			LOC			ORG			TIME			MACRO AVG			LEGAL			PER			LOC			ORG			TIME			MACRO AVG
					P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1
NeuroNER Extended	CoRoLa	-	-	13	92.80	96.11	94.43	94.51	96.94	95.71	85.45	84.05	84.74	90.33	89.30	89.81	91.77	92.86	92.31	90.97	91.85	91.41	89.66	80.05	84.58	82.40	81.10	81.75	77.25	75.00	76.11	85.60	75.21	80.07	85.45	82.82	84.12	84.07	78.84	81.37	93.30	87.86	90.50	94.16	96.99	95.56	68.04	73.33	70.59	80.85	72.17	76.26	92.06	80.56	85.93	85.68	82.18	83.90
NeuroNER Extended	CoRoLa	TRUE	-	14	90.71	97.51	93.99	98.31	93.72	95.96	88.04	82.17	85.01	88.98	90.27	89.62	93.38	91.06	92.20	91.88	90.95	91.41	86.53	83.29	84.88	86.49	75.59	80.67	83.56	70.93	76.73	83.36	77.09	80.11	88.67	79.30	83.72	85.72	77.24	81.26	91.07	89.08	90.06	100.00	96.24	98.08	80.89	70.56	75.37	79.67	77.14	78.38	94.20	73.26	82.42	89.17	81.26	85.03
NeuroNER Extended	CoRoLa	TRUE	TRUE	13	92.12	95.88	93.97	97.06	95.65	96.35	87.20	82.66	84.87	91.52	87.23	89.32	90.71	92.24	91.47	91.72	90.73	91.22	86.86	80.80	83.72	83.33	82.68	83.00	76.88	71.51	74.10	87.15	74.19	80.15	87.62	81.06	84.21	84.37	78.05	81.09	92.09	87.62	89.80	94.16	96.99	95.56	73.33	73.33	73.33	82.13	70.38	75.80	92.56	77.78	84.53	86.85	81.22	83.94
NeuroNER Extended	MARCELL	-	-	21	94.68	96.85	95.76	97.72	96.62	97.17	87.62	88.84	88.23	91.06	92.19	91.62	96.48	91.93	94.15	93.51	93.29	93.40	89.01	82.79	85.79	83.87	81.89	82.87	78.48	72.09	75.15	84.71	80.51	82.56	86.22	74.45	79.91	84.46	78.35	81.29	92.84	88.11	90.41	97.01	97.74	97.38	68.98	71.67	70.30	78.54	74.95	76.70	93.30	72.57	81.64	86.13	81.01	83.49
NeuroNER Extended	MARCELL	TRUE	-	13	86.32	97.82	91.71	97.50	94.36	95.91	86.98	81.44	84.12	88.89	89.63	89.26	92.26	90.31	91.27	90.39	90.71	90.55	82.96	82.54	82.75	79.84	77.95	78.88	81.41	73.84	77.44	85.35	80.68	82.95	90.24	81.50	85.65	83.96	79.30	81.56	85.65	88.35	86.98	99.24	97.74	98.48	79.39	72.78	75.94	81.09	80.12	80.60	92.50	77.08	84.09	87.57	83.21	85.34
NeuroNER Extended	MARCELL	TRUE	TRUE	13	92.58	96.50	94.50	97.99	94.36	96.14	86.41	79.02	82.55	91.28	88.55	89.89	90.65	92.11	91.37	91.78	90.11	90.94	89.73	82.79	86.12	84.03	78.74	81.30	80.14	68.02	73.58	87.06	75.90	81.10	83.04	81.94	82.48	84.80	77.48	80.97	91.71	88.59	90.12	95.59	97.74	96.65	73.17	66.67	69.77	79.55	69.58	74.23	94.54	78.12	85.55	86.91	80.14	83.39
NeuroNER Extended	CoRoLa+MARCELL	-	-	10	92.24	96.93	94.53	98.61	91.63	94.99	82.97	83.63	83.30	89.31	89.82	89.56	89.62	93.85	91.69	90.55	91.17	90.86	86.84	82.29	84.51	79.34	75.59	77.42	76.36	73.26	74.78	84.72	76.75	80.54	85.84	82.82	84.30	82.62	78.14	80.32	89.50	86.89	88.18	98.50	98.50	98.50	74.59	76.67	75.62	79.78	73.76	76.65	90.80	78.82	84.39	86.63	82.93	84.74
NeuroNER Extended	CoRoLa+MARCELL	TRUE	-	22	92.27	97.86	94.98	98.55	98.39	98.47	90.61	88.36	89.47	92.09	92.78	92.43	95.73	94.60	95.16	93.85	94.40	94.12	87.50	83.79	85.61	81.15	77.95	79.52	75.97	68.02	71.78	84.80	77.26	80.86	89.90	78.41	83.76	83.86	77.09	80.33	90.80	88.59	89.68	95.62	98.50	97.04	77.19	73.33	75.21	81.18	76.34	78.69	90.57	76.74	83.08	87.07	82.70	84.83
NeuroNER Extended	CoRoLa+MARCELL	TRUE	TRUE	10	89.70	97.47	93.43	97.01	94.20	95.59	86.25	82.90	84.54	87.83	89.41	88.61	91.53	89.94	90.73	90.46	90.78	90.62	84.91	82.79	83.84	78.69	75.59	77.11	81.01	74.42	77.58	83.42	78.29	80.78	87.06	77.09	81.78	83.02	77.64	80.24	88.57	90.29	89.42	96.99	96.99	96.99	70.62	69.44	70.03	81.17	77.14	79.10	91.59	71.88	80.54	85.79	81.15	83.40
NeuroNER Extended	CC	-	-	10	94.38	94.60	94.49	98.62	91.95	95.17	84.01	82.23	83.11	89.02	89.09	89.05	84.12	96.40	89.84	90.03	90.85	90.44	90.65	79.80	84.88	88.24	70.87	78.60	78.91	67.44	72.73	82.69	69.40	75.46	76.40	84.14	80.08	83.38	74.33	78.59	90.34	83.98	87.04	99.19	92.48	95.72	77.58	71.11	74.20	80.44	72.76	76.41	86.50	82.29	84.34	86.81	80.52	83.55
NeuroNER Extended	CC	TRUE	-	7	92.35	95.69	93.99	95.46	91.47	93.42	83.96	78.71	81.25	86.41	85.32	85.86	86.80	92.73	89.67	89.00	88.78	88.89	89.32	81.30	85.12	89.69	68.50	77.68	85.19	66.86	74.92	82.46	69.91	75.67	79.57	80.62	80.09	85.25	73.44	78.90	88.58	84.71	86.60	98.40	92.48	95.35	84.14	67.78	75.08	82.82	74.75	78.58	89.69	81.60	85.45	88.73	80.26	84.28
NeuroNER Extended	CC	TRUE	TRUE	8	93.41	94.09	93.75	95.95	91.47	93.65	85.29	76.29	80.54	89.12	86.26	87.67	93.91	84.29	88.84	91.54	86.48	88.94	89.64	79.80	84.43	88.78	68.50	77.33	80.60	62.79	70.59	86.02	68.38	76.19	86.49	70.48	77.67	86.31	69.99	77.30	91.32	84.22	87.63	99.20	93.23	96.12	82.76	66.67	73.85	82.78	68.79	75.14	96.57	68.40	80.08	90.53	76.26	82.78
NeuroNER Extended	Spacy	-	-	3	90.77	95.18	92.93	93.43	93.88	93.65	81.47	77.87	79.63	86.58	84.29	85.42	91.77	90.68	91.22	88.80	88.38	88.59	88.83	81.30	84.90	83.78	73.23	78.15	80.13	70.35	74.92	84.40	76.75	80.39	82.27	79.74	80.98	83.88	76.27	79.90	90.75	85.68	88.14	97.74	97.74	97.74	79.64	73.89	76.66	79.20	74.95	77.02	93.47	79.51	85.93	88.16	82.35	85.16
NeuroNER Extended	Spacy	TRUE	-	6	89.29	96.54	92.78	93.43	93.88	93.65	82.74	87.51	85.06	88.41	87.34	87.87	91.91	92.48	92.20	89.16	91.55	90.34	87.87	81.30	84.46	77.97	72.44	75.10	64.86	69.77	67.23	80.75	73.85	77.14	84.47	81.50	82.96	79.18	75.77	77.44	90.39	89.08	89.73	97.04	98.50	97.76	68.84	76.11	72.30	80.50	76.34	78.37	91.57	79.17	84.92	85.67	83.84	84.74
NeuroNER Extended	Spacy	TRUE	TRUE	8	92.76	97.13	94.89	95.99	96.46	96.22	75.26	92.60	83.03	81.14	85.21	83.13	89.83	94.41	92.07	87.00	93.16	89.97	87.13	81.05	83.98	76.27	70.87	73.47	57.53	73.26	64.45	66.90	64.62	65.74	82.55	85.46	83.98	74.08	75.05	74.56	91.60	87.38	89.44	94.93	98.50	96.68	58.44	78.89	67.14	70.46	70.18	70.32	86.81	82.29	84.49	80.45	83.45	81.92

PER, LOC, ORG, TIME (No LEGAL)

System	Embeddings	Gazetteer	Affixes	Epoch	TRAIN															VALID															TEST
					PER			LOC			ORG			TIME			MACRO AVG			PER			LOC			ORG			TIME			MACRO AVG			PER			LOC			ORG			TIME			MACRO AVG
					P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1	P	R	F1
NeuroNER Extended	CoRoLa	-	-	11	97.96	92.59	95.20	87.62	76.41	81.63	89.87	91.58	90.72	86.68	94.29	90.33	90.53	88.72	89.62	85.09	76.38	80.50	81.12	67.44	73.65	92.67	82.29	87.17	80.19	85.33	82.68	84.77	77.86	81.17	95.56	96.99	96.27	70.12	63.89	66.86	82.86	77.96	80.34	92.41	87.35	89.81	85.24	81.55	83.35
NeuroNER Extended	CoRoLa	TRUE	-	8	97.16	93.56	95.32	81.27	81.81	81.54	86.49	89.96	88.19	85.65	93.29	89.30	87.64	89.66	88.64	80.95	80.31	80.63	81.88	76.16	78.92	88.77	83.33	85.96	80.19	86.16	83.07	82.95	81.49	82.21	95.59	97.74	96.65	70.97	73.33	72.13	83.39	79.44	81.36	90.20	86.50	88.31	85.04	84.25	84.64
NeuroNER Extended	CoRoLa	TRUE	TRUE	8	98.41	89.69	93.85	83.49	76.35	79.76	87.00	90.50	88.72	85.52	94.23	89.67	88.60	87.69	88.15	82.76	75.59	79.01	83.57	68.02	75.00	89.19	82.68	85.81	81.31	87.19	84.15	84.21	78.37	81.18	100.00	95.49	97.69	72.02	67.22	69.54	81.06	79.14	80.09	91.22	87.01	89.06	86.07	82.22	84.10
NeuroNER Extended	MARCELL	-	-	13	95.94	95.17	95.55	87.51	82.41	84.88	90.75	92.13	91.43	84.66	97.82	90.76	89.72	91.88	90.79	82.40	81.10	81.75	80.14	68.02	73.58	92.40	80.73	86.17	77.52	90.50	83.51	83.12	80.09	81.57	94.93	98.50	96.68	75.29	72.78	74.01	84.98	77.81	81.24	91.34	91.97	91.65	86.64	85.27	85.94
NeuroNER Extended	MARCELL	TRUE	-	9	96.99	93.56	95.25	80.73	80.78	80.75	89.98	90.19	90.08	83.05	97.71	89.79	87.69	90.56	89.10	81.67	77.17	79.35	78.62	72.67	75.53	92.17	79.69	85.47	78.31	94.01	85.45	82.69	80.89	81.78	100.00	97.74	98.86	70.22	69.44	69.83	82.83	77.07	79.85	91.39	92.48	91.93	86.11	84.18	85.14
NeuroNER Extended	MARCELL	TRUE	TRUE	16	98.19	95.97	97.07	88.20	82.05	85.01	92.40	91.60	92.00	85.01	97.79	90.96	90.95	91.85	91.40	82.64	78.74	80.65	79.58	65.70	71.97	93.62	80.21	86.40	78.11	90.70	83.94	83.49	78.84	81.10	94.93	98.50	96.68	78.88	70.56	74.49	83.72	74.56	78.87	91.71	92.65	92.18	87.31	84.07	85.66
NeuroNER Extended	CoRoLa+MARCELL	-	-	7	98.09	90.82	94.31	78.46	81.50	79.95	87.81	89.26	88.53	83.41	97.19	89.77	86.94	89.69	88.30	80.34	74.02	77.05	79.11	72.67	75.76	90.13	82.03	85.89	78.79	91.32	84.59	82.09	80.01	81.04	100.00	97.74	98.86	68.65	70.56	69.59	84.51	79.88	82.13	89.75	91.28	90.51	85.73	84.87	85.29
NeuroNER Extended	CoRoLa+MARCELL	TRUE	-	24	98.86	97.91	98.38	91.09	88.66	89.86	92.91	93.75	93.33	86.59	98.71	92.25	92.36	94.76	93.54	82.79	79.53	81.12	77.78	69.19	73.23	91.65	80.08	85.48	78.14	90.08	83.69	82.59	79.72	81.13	96.32	98.50	97.40	74.14	71.67	72.88	83.70	78.25	80.89	90.83	89.74	90.28	86.25	84.54	85.39
NeuroNER Extended	CoRoLa+MARCELL	TRUE	TRUE	11	97.99	94.04	95.97	83.28	84.90	84.08	90.47	90.31	90.39	83.93	98.14	90.48	88.92	91.85	90.36	80.17	73.23	76.54	76.19	74.42	75.29	92.50	80.34	85.99	78.20	93.39	85.12	81.77	80.34	81.05	100.00	97.74	98.86	73.82	78.33	76.01	84.05	77.96	80.89	90.32	92.48	91.39	87.05	86.63	86.84
NeuroNER Extended	CC	-	-	9	96.11	91.47	93.73	83.11	81.44	82.27	87.53	89.91	88.71	83.98	97.73	90.34	87.68	90.14	88.89	86.17	63.78	73.30	81.75	65.12	72.49	86.84	77.34	81.82	78.91	92.77	85.28	83.42	74.75	78.85	100.00	94.74	97.30	78.53	71.11	74.64	83.41	78.11	80.67	91.20	92.14	91.67	88.28	84.02	86.10
NeuroNER Extended	CC	TRUE	-	7	97.92	90.82	94.24	81.49	80.11	80.80	89.24	89.79	89.51	83.75	96.82	89.81	88.10	89.39	88.74	91.57	59.84	72.38	80.26	70.93	75.31	88.67	75.39	81.49	77.93	91.94	84.36	84.61	74.53	79.25	99.16	88.72	93.65	81.88	72.78	77.06	84.04	76.33	80.00	91.05	90.43	90.74	89.03	82.06	85.41
NeuroNER Extended	CC	TRUE	TRUE	12	93.13	93.88	93.50	80.57	84.72	82.59	88.84	91.90	90.34	84.38	97.79	90.59	86.73	92.07	89.32	85.85	71.65	78.11	75.31	70.93	73.05	87.82	76.95	82.03	78.80	92.15	84.95	81.94	77.92	79.88	97.69	95.49	96.58	80.59	76.11	78.29	82.16	77.66	79.85	91.62	91.62	91.62	88.02	85.22	86.59