There are a number of factors outside of your library setup that will impact site performance.
In this talk we will specifically go over how a good library set up can help with loading only the necessary js and css on your page.
Session Recording: https://www.youtube.com/watch?v=R_W4eoryZoE
Session Slides: Google Slides