Commits · c8abda0fe231b300ef0ddf9773c6c803482fbf1b · oschmanf / ppg-moderation-classifier · GitLab

Snippets Groups Projects

Jul 19, 2023
- Grouping of util functions for training and evaluation in separate files · c8abda0f
  Franziska Oschmann authored 1 year ago
  
  c8abda0f
Jul 13, 2023
- Adjust averaging of precision, recall, f1 · 7d0a677a
  Franziska Oschmann authored 1 year ago
  
  7d0a677a
- Only return most common topics · 9fcfed88
  Franziska Oschmann authored 1 year ago
  
  9fcfed88
- Fix issue with F1 computing · c70cbc71
  Franziska Oschmann authored 1 year ago
  
  c70cbc71
- Smaller changes in train scripts · 2cd7c834
  Franziska Oschmann authored 1 year ago
  
  2cd7c834
- Speed up inference by loading tokenizer and model seperately and not as pipeline · 6728a32a
  Franziska Oschmann authored 1 year ago
  
  6728a32a
Jul 11, 2023
- Add more evaluation metrics to BERT evaluation · dbf76ce4
  Franziska Oschmann authored 1 year ago
  
  dbf76ce4
- Drop rows with row indices when removing duplicates · fd680f20
  oschmanf authored 1 year ago
  
  fd680f20
Jul 10, 2023
- Adjust params for training · bd0a04e0
  Franziska Oschmann authored 1 year ago
  
  bd0a04e0
- Adjust main.py for loading of logs · 52ee3dbc
  Franziska Oschmann authored 1 year ago
  
  52ee3dbc
- BERT: Add saving of logs to training and load them in eval-script · 96bda3f5
  Franziska Oschmann authored 1 year ago
  
  96bda3f5
- MNB: Add saving of logs to training and load them in eval-script · 828cec5f
  Franziska Oschmann authored 1 year ago
  
  828cec5f
Jul 07, 2023
- moderation_classifier/train_MNB.py: Clean code · 4c110768
  Franziska Oschmann authored 1 year ago
  
  4c110768
- Add fit and transform methods to TextProcessor to allow integration into pipelines · e8e6d084
  Franziska Oschmann authored 1 year ago
  
  e8e6d084
Jul 06, 2023
- Split Loading into reading csv and filtering · dc1a5289
  Franziska Oschmann authored 1 year ago
  
  dc1a5289
- Add removal of duplicates and option to filter cooments by topic · 3f4a8f21
  Franziska Oschmann authored 1 year ago
  
  3f4a8f21
- Add rejection rate and number of comments to resultsdataframe · 152eabbe
  Franziska Oschmann authored 1 year ago
  
  152eabbe
Jun 30, 2023
- Add model evaluation to moderation_classifier · 19e3638b
  Franziska Oschmann authored 1 year ago
  
  19e3638b
- Evaluate trained BERT · d0ce44af
  oschmanf authored 1 year ago
  
  d0ce44af
- Add bash scripts for model training on cluster · 35189e2e
  oschmanf authored 1 year ago
  
  35189e2e
Jun 29, 2023
- Style check · 36d1cc06
  Franziska Oschmann authored 1 year ago
  
  36d1cc06
- Add option to split data · 643b5b01
  Franziska Oschmann authored 1 year ago
  
  643b5b01
- Add optional text preprocessing · 567cbb18
  Franziska Oschmann authored 1 year ago
  
  567cbb18
- Save logs during training · 64a06473
  Franziska Oschmann authored 1 year ago
  
  64a06473
- Add script for loading of finetuned Bert model and prediction based on test set · 4a41297a
  oschmanf authored 1 year ago
  
  4a41297a
- Save models after training · 65d5cf14
  oschmanf authored 1 year ago
  
  65d5cf14
Jun 22, 2023
- Add Bert training with TF and Torch to moderation_classifier · e3812588
  oschmanf authored 1 year ago
  
  e3812588
- Add instructions to create environements for TF and Torch on Euler · f1a82fa4
  oschmanf authored 1 year ago
  
  f1a82fa4
Jun 21, 2023
- Add script to train Bert · 226c8a8c
  Franziska Oschmann authored 1 year ago
  
  226c8a8c
Jun 14, 2023
- Add notebook with examples for text processing · 1e332211
  Franziska Oschmann authored 1 year ago
  
  1e332211
- Add training of MNB model · 6e583d8c
  Franziska Oschmann authored 1 year ago
  
  6e583d8c
Jun 12, 2023
- Add first script for BERT finetuning with TF · f00e877d
  Franziska Oschmann authored 1 year ago
  
  f00e877d
Jun 02, 2023
- Add documentation · a0530799
  Franziska Oschmann authored 1 year ago
  
  a0530799
- Add first notebook for first data exploration · 981458dd
  Franziska Oschmann authored 1 year ago
  
  981458dd
- Add entry point for tool to setup.py · e321ef4a
  Franziska Oschmann authored 1 year ago
  
  e321ef4a
- Add file containing preprocessing · aa6d7cad
  Franziska Oschmann authored 1 year ago
  
  aa6d7cad
- Add main file for tool · d342d238
  Franziska Oschmann authored 1 year ago
  
  d342d238
May 10, 2023
- Set-up of repo structure · 91ce37b6
  Franziska Oschmann authored 1 year ago
  
  91ce37b6
- Add .gitignore · 41d54851
  Franziska Oschmann authored 1 year ago
  
  41d54851
- first commit · 397a47a7
  Franziska Oschmann authored 1 year ago
  
  397a47a7