if you want to have all the data on the same sheet, you could arrange them in columns and then use the “Move chart range…” functions.
Another way is to have the data on different sheets, then use the “Point Chart” command as described on this page.
As I keep telling everybody who do not want to hear about it I have personally taken to using R with the Tidyverse and ggplot2 libraries for most of my data analysis and visualization work. It’s not easy to learn, but there are good tutorials on the web, for example “R for data science” by Hadley Wickham.
What you describe sounds exactly like the kind of task that R/Tidyverse/ggplot2 might be more suitable for than Excel. While these tools are available free of charge (also have a look at RStudio), you do need to invest some time to learn to handle them. But I found it’s worth it. Results are 100% reproducible. Just my two cents