We ingest about 10million raw events per day using GCP technologies Pub/Sub, Dataflow, & BigQuery. Once its there we apply column-level security to make sure our employees can't access data they're not supposed to be able to access. I'd love to tell you about how we do it.
N.B. This is nothing to do with SQL Server. Or Azure. I just thought it might be interesting for folks that aren't used to GCP technologies to know more about them.