Strategies to scale data processing architecture to maximize the impact of GenAI