Scalability in BI and Analytics

1. What is scalability in analytics?

Scalability is the ability of a system to adapt its performance and cost to changes in application and system processing demands. A platform or piece of software requires two main properties to successfully scale:

1. The capability to increase or decrease its capacity by adding or removing sources to adapt to the changing amount of data.
2. The capability to make this capacity available to those who need or want it.

A scalable analytics platform enables this to happen automatically, quickly, and securely, while maintaining a separation between user groups – in terms of data, user privacy, and cyber security.

When we talk of analytics scalability, we are referring to the ability to use data to understand, solve, and meet a large variety of use cases and business goals. These use cases and goals come in many forms, so the analytics must be flexible enough to address different cases in different ways. This might include analytics for internal BI or the use of analytics across other applications.

2. Who can benefit from scalable analytics?

Scalable analytics solutions are particularly suitable for the following types of businesses:

3. How to achieve scalable analytics/scalability in analytics?

• Scalable data storage:
  This requires a data storage solution that can handle a growing amount of data and support the business as it grows. This could involve using a third-party data warehouse, like cloud-based storage for example.
• Scalable analytics platform:
  A scalable analytics platform allows the company to query large data amounts, effectively distribute analytics to a growing number of users, and integrate the analytics capabilities with various applications without affecting the analytics performance. This could include business applications, messaging platforms like Slack, or developer interfaces.

We can show how scalable analytics can be achieved in terms of data volume, users/user groups and use cases, and how this impacts the overall cost.

3.1 Data volume

From a data volume perspective, scalability guarantees that the infrastructure companies have purchased can withstand future data demands. Currently, we can divide companies based on the technology they use to store and manage their data — on-premise data storage or cloud data storage.

On-premises storage provides control and security but may have limitations as data volume increases. Cloud storage allows for scalability and may be a good option for companies that outgrow their on-prem solution. Migrating from on-prem to cloud storage involves renting capacity, building a storage system, and transferring data.

Horizontal scaling is an appropriate way for businesses to simply add or remove resources – such as processing power or storage – to meet the demands of their workload. This form of scalability is also tied to cloud-native capability, and it can increase capacity automatically and seamlessly as the volume of data grows. As a result, it is well-suited for applications and workloads with rapid or unpredictable data volume increases.

3.2 Users and use cases

When choosing a suitable analytical tool, it is necessary to consider whether it makes scaling possible. At some point, scalability usually becomes an important function that affects areas across the entire analytics solution. An analytics platform with the ability to scale should be able to:

• Unify data management and analytics throughout the organization or allow you to create your own solution. In this case, the analytics platform is expected to expand flexibly within the user base.
• Create a stand-alone tool that will work alongside other analytics tools and applications that are already in use in your organisation.

A multi-tenant analytics platform allows companies to deliver analytics via a single platform that serves multiple tenants. Depending on the use case, tenants can be customers, departments, business units, or even single users with specific requirements.

Multitenancy enables companies to create an application just once by creating essential metrics, designing main dashboards, or providing other settings and deploying them to many tenants in separate workspaces for individual users and user groups. Multitenancy ensures that, within each tenant, users can only access the data they are authorized to use. Here, they can make changes within their workspace as they want.

A company can deliver analytics to their tenants — separate users or user groups – regardless of their geographic location. These tenants may be:

b. Use cases

The best BI solutions are able to handle a variety of situations and use cases. A scalable analytics platform should allow a company to scale for different use cases and support its business goals. Some typical use case examples include:

• Internal BI and analytics BI and analytics are often used by internal teams and stakeholders within a company. The goal of giving more internal stakeholders access to analytics is to enable them to make better decisions based on data analysis, facts, and insights, rather than relying on guesswork. Internal analytics can help a company increase profits and make more cohesive decisions by fostering a data-driven culture.
• Integrate with different business/custom applications (embedded analytics) Integrating BI and analytics with business applications can bring additional value to an organization. Instead of building a separate analytics service within their application, IT teams can embed the analytics interface directly into the application. This allows organizations to easily incorporate analytics into the tools they use to perform their work.
• User interface A scalable analytics platform allows users and developers to access, modify, or obtain information about objects and functions through various interfaces, such as APIs or developer interfaces (Jupyter Notebook, Deepnote, etc.). This makes it easy for them to get the information they need.
• Other communication tools Scalable analytics may allow users to integrate analytics with communication tools like Slack and MS Teams. This enables them to easily obtain reports and information through simple queries without needing to log into the analytics platform.

3.3 Price Before selecting a BI and analytics platform, it’s important to consider your price expectations. In a dynamic environment, the per-user pricing model can be expensive because it is tied to a specific number of users. It may not be cost-effective due to the difficulty in predicting the future user base.

A more flexible and scalable pricing model is important for a scalable analytics platform, as it allows the platform to adapt to changes in your business (such as fluctuations in the number of users) in a cost-effective way. The per-workspace pricing model is a good solution, as it charges a fixed fee for each workspace used, regardless of the number of users or the amount of activity within that workspace.

The per-workspace option can be a flexible and cost-effective pricing model for:

• Companies that have a large number of teams or departments and want to give each one its own dedicated workspace.
• Companies that operate in the B2B market and deliver analytics to their customers but cannot predict the future user base.
• Companies that have fewer users, or users who do not need to make queries and only require access to reports/dashboards to check business indicators/KPIs.

It is worth noting that a per-workspace pricing model may not be the most economical option for all companies, depending on their use case and the needs of the organization.

4 Scalability with the GoodData analytics platform

When deciding which scalable analytics platform is right for you, you might like to consider the GoodData platform. Here is a brief overview of how GoodData deals with scalability:

Data volume GoodData has a distributed architecture that has been specifically designed to support the efficient processing and analysis of large amounts of data from multiple data sources. It uses techniques like data partitioning and parallel processing to quickly run queries and analyses on large datasets without degrading analytics performance.

Analytics platform GoodData is a platform that helps organizations host and manage multiple tenants or customers on a single platform via different workspaces. It offers features like user and role management, data governance tools, and security and compliance features to help ensure the integrity and privacy of sensitive data. These features help organizations control access to data and resources at the tenant level and meet the needs of regulated companies.

Price GoodData’s workspace pricing model allows companies to buy a certain number of workspaces for their users — one workspace can be accessed by different numbers of users inside or outside of the company. It’s also worth noting that the cost of a workspace may vary depending on the features and services that are included.

As a scalable analytics platform, GoodData also brings other benefits, including:

Automatic analytics delivery
GoodData is a cloud-based analytics platform that allows organizations to easily and automatically deliver analytics to their users through customizable dashboards, metrics, reports, real-time data, and a robust API. Thanks to the parent-child relationship between workspaces, every change in the parent workspace is automatically displayed in the child workspaces. These features enable efficient access and use of analytics by users and user groups, enabling organizations to make data-driven decisions between different business units and improve their operations.

Self-service analytics
GoodData provides a self-service analytics platform that is designed to be easy to use. It allows all kinds of users to access and analyze data on their own without the participation of data teams. Thanks to GoodData’s semantic layer and MAQL, users are easily able to understand and utilize data, even if they don’t have a background in data analysis or programming.

Embedded analytics
A range of tools and features enable organizations to easily embed analytics into their own applications and platforms, providing users with access to data and insights within their preferred tools. For more on this, check out our documentation on how to embed & integrate.

Summary

The most important thing to remember is that scalability is a system’s capability to effectively adapt to dynamically changing environments.

Other key takeaways from this e-book include:

• Scalability in analytics refers to a system’s ability to adapt its performance and cost to changes in processing demands and data volume.
• Scalable analytics allows businesses to easily and quickly respond to new technologies and changes, as well as reduce the time and cost of maintaining analytics tools.
• Scalable analytics is useful for fast-growing companies, data-driven companies, companies with branches and stakeholders around the world, and companies operating in the B2B market.
• Scalability ensures that the infrastructure can handle a growing amount of data and support the business as it grows — for this, the necessary data volume is required.
• Scalability allows for the support of a growing number of users, user groups, and use cases, integrating with various applications without affecting analytics performance.
• Scalable analytics uses the per-workspace pricing model, charging a fixed fee for each workspace rather than for each individual user.

Next steps with GoodData

If you have further questions you might find the following resources helpful:

• Learn about multitenancy in analytics in this blog post: What is multi-tenant analytics?

• Check out this ebook to discover how to choose the best solution in relation to your user base size: Architecture: Analytics for a Few vs. Analytics for Many.

• Download this to learn How to Evaluate BI Tools to Choose the Best One.

• Learn how scalability can resolve bottlenecks here: Anti-patterns for scaling analytics.

  Want to try the GoodData platform for yourself? Do not hesitate to contact us for a demo, or simply start a free trial. Our team is ready to answer all your questions.