# Ensemble learning using transformers

**URL:** <https://discuss.huggingface.co/t/ensemble-learning-using-transformers/6465>\
**Category:** 🤗Transformers\
**Created:** [May 30, 2021, 2:28pm UTC](https://discuss.huggingface.co/t/ensemble-learning-using-transformers/6465 "2021-05-30T14:28:22Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![helloworld123-lab](https://avatars.discourse-cdn.com/v4/letter/h/b3f665/32.png) [@helloworld123-lab](https://discuss.huggingface.co/u/helloworld123-lab)\
**Post date:** [May 30, 2021, 2:28pm UTC](https://discuss.huggingface.co/t/ensemble-learning-using-transformers/6465/1 "2021-05-30T14:28:22Z")

</div>

I work on multiple-choice QA, and I want to use ensemble learning on transformers.  
Assume the first model is trained with Bert, the second is trained with Roberta and etc. I want to _ensemble_ predictions of these models using majority voting to develop the final system. Is there a notebook that I can follow? or how can I do it?  
Thank you

---

<div class="post-metadata">

**Author:** ![Santarabantoosoo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/santarabantoosoo/32/5489_2.png) [@Santarabantoosoo](https://discuss.huggingface.co/u/Santarabantoosoo)\
**Post date:** [July 23, 2022, 3:10am UTC](https://discuss.huggingface.co/t/ensemble-learning-using-transformers/6465/2 "2022-07-23T03:10:14Z")

</div>

Yes indeed that would be really helpful