Skip to main content

RedShift

RedShift is a fully managed cloud data warehouse designed to deliver fast, scalable, and cost-effective analytics on datasets of all sizes. By leveraging columnar storage and massively parallel processing (MPP), Redshift ensures high-performance query execution for even the most complex workloads.

Key Features​

  1. Scalability: Redshift allows you to scale compute and storage independently, adapting seamlessly to fluctuating workloads without downtime.

  2. High Performance: It uses columnar storage and data compression techniques, along with parallel processing, to accelerate query execution and optimize storage.

  3. Semi-Structured Data Support: Redshift’s SUPER data type enables seamless handling of semi-structured data like JSON, opening doors to broader analytics use cases.

  4. Data Sharing: Share live, secure data across multiple Redshift clusters or external accounts without creating duplicates.

  5. Integration: Redshift integrates effortlessly with popular ETL tools, BI platforms, and cloud services like Amazon S3 and AWS Glue, streamlining data ingestion and reporting.

  6. Enhanced Security: Built-in encryption, role-based access controls, and AWS Identity and Access Management (IAM) integration ensure robust data protection.

Getting Started​

Requirements​

Before proceeding, ensure the following:

  1. Sign in to the AWS Management Console. If you don’t have an account, create one to access AWS services.
  2. Open the Amazon Redshift service.
  3. Create and activate a Redshift cluster if you don’t already have one.
  4. (Optional) Enable network connectivity between Boltic and your Redshift cluster if they are in different VPCs.
  5. (Optional) Set up a staging S3 bucket for the COPY strategy, if needed.

Step-by-Step Guide​

To ensure the boltic_user has permissions to:

-- **add create schema permission
GRANT CREATE ON DATABASE database_name TO boltic_user;

-- add create table permission
GRANT usage, create on schema my_schema TO boltic_user;

Best Practices​

  • Use Descriptive Naming Conventions: Consistent naming for roles, schemas, and tables.
  • Review User Permissions Regularly: Ensure users have the minimum required access.
  • Suspend Unused Warehouses: Pause warehouses when not in use to save costs.
  • Optimize with Distribution and Sort Keys: Improve query performance with proper keys.
  • Leverage Concurrency Scaling: Use it to handle high query loads efficiently.
  • Efficient Data Loading with COPY: Load data in large batches and use columnar compression.
  • Use Redshift Spectrum for S3 Data: Query data in S3 directly to save costs.
  • Enable Automated Snapshots: Regularly back up your data for disaster recovery.
  • Run VACUUM Regularly: Reclaim space and optimize table sorting.
  • Secure Data with Encryption: Use encryption and network security best practices.

Setup Guide to Integrate Redshift With Boltic​

This guide will give you a brief idea of what steps you need to follow to integrate Redshift into Boltic.

  1. Search for redshift destination: Go to integrations > destinations > Add new destination Integration Name

    Integration Name

  2. Add new destination integration: Enter a unique name for this Redshift integration. Integration Name

  3. Add new destination integration: Add description and further redshift account credentials Integration Name

  4. Test and save: Validate your configuration by clicking Test & Save. This ensures that the connection is successfully established. Integration Name

Congratulations! You’ve successfully configured Redshift roles, users, warehouses, databases, and schemas for Boltic integration. For further assistance, refer to Redshift’s official documentation.