Comparison of pruned TTS model

TTS setup: LJspeech (single speaker). Text2Mel and Mel2wav are both trained on LJspeech.
References: Transformer-TTS, Parallel Wavegan, PARP

Prune Text2Mel with PARP

ID	Text	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	75% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	99% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	75% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	99% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Prune Text2Mel with PARP-Progressive

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	70%-80% sparse Transformer-TTS (latest) + Full parallal wavegan	70%-90% sparse Transformer-TTS (latest) + Full parallal wavegan	80%-90% sparse Transformer-TTS (latest) + Full parallal wavegan	85%-90% sparse Transformer-TTS (latest) + Full parallal wavegan	70%-95% sparse Transformer-TTS (latest) + Full parallal wavegan	80%-95% sparse Transformer-TTS (latest) + Full parallal wavegan	85%-95% sparse Transformer-TTS (latest) + Full parallal wavegan	90%-95% sparse Transformer-TTS (latest) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of amount of finetuning data in PARP Step 2 at 70% sparsity

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% finetune data + 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% finetune data + 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of amount of finetuning data in PARP Step 2 at 90% sparsity

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% finetune data + 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% finetune data + 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of Knowledge Distillation in PARP Step 2

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(+KD) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(+KD) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(+KD) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(+KD) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of Random Init in PARP Step 1

ID	Text	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(Random) 95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(Random) 95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of TTS-Augmentation (vanilla mix tr_no_dev and train-clean-100-syn) in PARP Step 2

ID	Text	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

Effect of TTS-Augmentation (first train-clean-100-syn then tr_no_dev) in PARP Step 2

ID	Text	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(TTS-aug) 95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(TTS-aug) 95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

IMP (2 iteration)

ID	Text	Full Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 10% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 20% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 30% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 40% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 50% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 60% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 70% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 80% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 85% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 90% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(IMP) 95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan	(PARP) 95% sparse Transformer-TTS (valid.loss.best) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:

ID	Text	Full Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 10% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 20% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 30% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 40% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 50% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 60% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 70% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 80% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 85% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 90% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(IMP) 95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan	(PARP) 95% sparse Transformer-TTS (valid.loss.ave) + Full parallal wavegan
LJ049-0032	Text: had no special design or equipment which would have permitted the Secret Service agent riding in the driver's compartment	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0037	Text: In contrast, the Vice Presidential vehicle, although not specially designed for that purpose,	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ049-0098	Text: In nineteen oh two bills passed both Houses of Congress but failed of enactment when the Senate refused to accept the conference report.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0028	Text: no sizable organization can achieve efficiency without the careful analysis and demarcation of responsibility	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0007	Text: have made it difficult for the Treasury to maintain close and continuing supervision.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:
LJ050-0015	Text: The Commission recommends that the Secretary of the Treasury appoint a special assistant with the responsibility of supervising the Service.	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw:	Raw: