What kind of caterpillar and how to keep it healthy?

I think it is probably a wooly bear. Some can look more yellow than orange. It sounds like you are caring for it correctly. It will become more and more lazy as it gets ready to build its cocoon. A few weeks later it will hatch as a tiger moth and you can let it go.