Commits · 0c9ebf4516d5d5ee532200b7ab8c4ecbfc774613 · oschmanf / ppg-moderation-classifier · GitLab

Snippets Groups Projects

Aug 10, 2023
- Merge branch 'dev-train-models' into 'main' · 0c9ebf45
  oschmanf authored 1 year ago
  
  Dev train models See merge request !2
  0c9ebf45
- Add parameters for evaluation of pretrained models · a11e862f
  Franziska Oschmann authored 1 year ago
  
  a11e862f
- Add filtering by hsprob · b4c126e7
  Franziska Oschmann authored 1 year ago
  
  b4c126e7
Jul 20, 2023
- Add bash script for train runs on Euler · ebb70760
  Franziska Oschmann authored 1 year ago
  
  ebb70760
- Add name of pretrained model as command line argument and to logs · 4c799493
  Franziska Oschmann authored 1 year ago
  
  4c799493
Jul 19, 2023
- Update of README.md · 7ec0ab60
  Franziska Oschmann authored 1 year ago
  
  7ec0ab60
- Add command line arguments for newspaper and topic · 02c0d772
  Franziska Oschmann authored 1 year ago
  
  02c0d772
- Grouping of util functions for training and evaluation in separate files · 510fb6dc
  Franziska Oschmann authored 1 year ago
  
  510fb6dc
- Grouping of util functions for training and evaluation in separate files · c8abda0f
  Franziska Oschmann authored 1 year ago
  
  c8abda0f
Jul 13, 2023
- Fix difference between remote and local code · 6f63e822
  oschmanf authored 1 year ago
  
  6f63e822
- Adjust averaging of precision, recall, f1 · 7d0a677a
  Franziska Oschmann authored 1 year ago
  
  7d0a677a
- Adjust averaging of precision, recall, f1 · af05060b
  Franziska Oschmann authored 1 year ago
  
  af05060b
- Only return most common topics · 9fcfed88
  Franziska Oschmann authored 1 year ago
  
  9fcfed88
- Fix issue with F1 computing · c70cbc71
  Franziska Oschmann authored 1 year ago
  
  c70cbc71
- Smaller changes in train scripts · 2cd7c834
  Franziska Oschmann authored 1 year ago
  
  2cd7c834
- Speed up inference by loading tokenizer and model seperately and not as pipeline · 6728a32a
  Franziska Oschmann authored 1 year ago
  
  6728a32a
Jul 11, 2023
- Add more evaluation metrics to BERT evaluation · dbf76ce4
  Franziska Oschmann authored 1 year ago
  
  dbf76ce4
- Drop rows with row indices when removing duplicates · fd680f20
  oschmanf authored 1 year ago
  
  fd680f20
Jul 10, 2023
- Adjust params for training · bd0a04e0
  Franziska Oschmann authored 1 year ago
  
  bd0a04e0
- Adjust main.py for loading of logs · 52ee3dbc
  Franziska Oschmann authored 1 year ago
  
  52ee3dbc
- BERT: Add saving of logs to training and load them in eval-script · 96bda3f5
  Franziska Oschmann authored 1 year ago
  
  96bda3f5
- MNB: Add saving of logs to training and load them in eval-script · 828cec5f
  Franziska Oschmann authored 1 year ago
  
  828cec5f
Jul 07, 2023
- moderation_classifier/train_MNB.py: Clean code · 4c110768
  Franziska Oschmann authored 1 year ago
  
  4c110768
- Add fit and transform methods to TextProcessor to allow integration into pipelines · e8e6d084
  Franziska Oschmann authored 1 year ago
  
  e8e6d084
Jul 06, 2023
- Split Loading into reading csv and filtering · dc1a5289
  Franziska Oschmann authored 1 year ago
  
  dc1a5289
- Add removal of duplicates and option to filter cooments by topic · 3f4a8f21
  Franziska Oschmann authored 1 year ago
  
  3f4a8f21
- Add rejection rate and number of comments to resultsdataframe · 152eabbe
  Franziska Oschmann authored 1 year ago
  
  152eabbe
Jun 30, 2023
- Add model evaluation to moderation_classifier · 19e3638b
  Franziska Oschmann authored 1 year ago
  
  19e3638b
- Evaluate trained BERT · d0ce44af
  oschmanf authored 1 year ago
  
  d0ce44af
- Add bash scripts for model training on cluster · 35189e2e
  oschmanf authored 1 year ago
  
  35189e2e
Jun 29, 2023
- Style check · 36d1cc06
  Franziska Oschmann authored 1 year ago
  
  36d1cc06
- Add option to split data · 643b5b01
  Franziska Oschmann authored 1 year ago
  
  643b5b01
- Add optional text preprocessing · 567cbb18
  Franziska Oschmann authored 1 year ago
  
  567cbb18
- Save logs during training · 64a06473
  Franziska Oschmann authored 1 year ago
  
  64a06473
- Add script for loading of finetuned Bert model and prediction based on test set · 4a41297a
  oschmanf authored 1 year ago
  
  4a41297a
- Save models after training · 65d5cf14
  oschmanf authored 1 year ago
  
  65d5cf14
Jun 22, 2023
- Add Bert training with TF and Torch to moderation_classifier · e3812588
  oschmanf authored 1 year ago
  
  e3812588
- Add instructions to create environements for TF and Torch on Euler · f1a82fa4
  oschmanf authored 1 year ago
  
  f1a82fa4
Jun 21, 2023
- Add script to train Bert · 226c8a8c
  Franziska Oschmann authored 1 year ago
  
  226c8a8c
Jun 14, 2023
- Add notebook with examples for text processing · 1e332211
  Franziska Oschmann authored 1 year ago
  
  1e332211