Ok if I get you correctly, I think Thymeleaf is the best option to choose, you can create a template page like this one:
template.html:
<!DOCTYPE html>
<html xmlns:th="http://www.thymeleaf.org"
xmlns:layout="http://www.ultraq.net.nz/thymeleaf/layout">
/* Here you put your CSS and JS files and so on.. */
<body>
<header> ... </header>
/* Here you can put anything you want beacause this template will be
always executed */
<section th:fragment="content></section>
<footer> ... </footer>
</body>
You can make your own header and footer for all your HTML pages.
Then you can create your HTML pages using this template.
For example if you choose to realize a homepage you can do it like this
home.html:
<!DOCTYPE html>
<html xmlns:th="http://www.thymeleaf.org"
xmlns:layout="http://www.ultraq.net.nz/thymeleaf/layout">
layout:decorator="template">
/* Here you have your CSS, JS files.. and body tag */
<div layout:fragment="content"> ... </div>
Anything you'll put in your div will be included in the section tag of your template page.