Search Typeahead How does our client know which application servers to talk to. How does it know which application servers have gone down and which ones are still working?


#1

Q: How does our client know which application servers to talk to. How does it know which application servers have gone down and which ones are still working?


#2

First we need to handle no of connections client will connect. Also when we mention load balancers. We need to think from scale perspective from top to down. That means from front gateway/API gateway to an array of load balancers so that each load balancer those many connections. App layers can be stateless since all are same. We need to estimate how many app servers will be required as well [or even if it is auto-scale we need to estimate memory/cpu/cores etc for a single pod/node]