im currently facing a challenge i need to automate spark jobs ( basically spark jobs trigger the job which takes data from input tables and put into output tables ...these are hive tables) is there any tool or way to automate end to end effectively.....thanks in advance..any approaches are welcome