Malaysia Open Data Catalogue Connector

info@ismena.com

Connector Details

Type

Virtual machines, Single VM , BYOL

Runs on

Google Compute Engine

Last Update

24 October, 2024

Category

Overview

The Malaysia Open Data Catalogue Connector facilitates seamless integration with the Malaysia Data Catalogue API, a service provided by the Malaysia Open Data Portal, offering access to a wide range of datasets hosted on data.gov.my. This includes general datasets via the Data Catalogue endpoint and OpenDOSM-specific datasets for economic and statistical data. The connector acts as a proxy to streamline data retrieval, supporting actions for querying datasets with filtering and limiting capabilities in JSON format, enabling data-driven applications and analytics in Malaysia.

Integration Overview

This document provides a detailed guide for each integration point, its purpose, configuration, and workflow support using the Malaysia Data Catalogue API Connector.
Supported Integration Action Points

getDataCatalogue: Retrieve data from the general Data Catalogue.
getOpenDOSMData: Retrieve data from the OpenDOSM Data Catalogue.

Detailed Integration Documentation

2.1 Get Data Catalogue Retrieval

Action	getDataCatalogue
Purpose	Retrieves data from a specified dataset in the general Data Catalogue, such as fuel prices or demographic data, with flexible filtering and limiting options. This supports applications requiring diverse Malaysian datasets for analytics or visualization.
Configuration	Ensure the connector is configured with the base URL via the `CONNECTOR_ENV_MALAYSIADATACATALOGUEAPI_BASE_URL` environment variable.
Parameters	Required: id: Unique dataset identifier (string, e.g., `fuelprice`). Optional: limit: Limits the number of records returned (integer, minimum: 1, e.g., 3). contains: Filters data by a specific value in a column (string, e.g., `somevalue@column_name`).
Output	Successful: Returns a JSON array of dataset records with: Dynamic object structure based on the dataset’s metadata (e.g., for `fuelprice`: date, price, etc.), as defined on the Data Catalogue page (https://data.gov.my/data-catalogue). Failure: Returns error details (e.g., 400: Invalid or missing id parameter, 404: Dataset not found, 500: Server error).
Workflow Example	Configure the connector with the appropriate base URL. Execute the `getDataCatalogue` action with `id=fuelprice` and `limit=3`. Process the response to display fuel price trends in a dashboard.

2.2 Get OpenDOSM Data Retrieval

Action	getOpenDOSMData
Purpose	Retrieves data from OpenDOSM-specific datasets, such as Core CPI or economic indicators, with filtering and limiting options. This supports specialized statistical analysis for economic research or policy-making.
Configuration	Ensure the connector is configured with the base URL via the `CONNECTOR_ENV_MALAYSIADATACATALOGUEAPI_BASE_URL` environment variable.
Parameters	Required: id: Unique OpenDOSM dataset identifier (string, e.g., `cpi_core`). Optional: limit: Limits the number of records returned (integer, minimum: 1, e.g., 3). contains: Filters data by a specific value in a column (string, e.g., `somevalue@column_name`).
Output	Successful: Returns a JSON array of dataset records with: Dynamic object structure based on the dataset’s metadata (e.g., for `cpi_core`: date, index, etc.), as defined on the OpenDOSM Data Catalogue page (https://data.gov.my/opendosm). Failure: Returns error details (e.g., 400: Invalid or missing id parameter, 404: Dataset not found, 500: Server error).
Workflow Example	Execute the `getOpenDOSMData` action with `id=cpi_core` and `limit=5`. Analyze the Core CPI data for economic trends. Integrate into a financial forecasting tool.

Workflow Creation with the Connector

Example Workflow: Economic and Consumer Insights Dashboard

Retrieve Fuel Price Data	Use the `getDataCatalogue` action with `id=fuelprice` to fetch recent fuel price data. Visualize price trends for consumer cost analysis.
Fetch Economic Indicators	Execute the `getOpenDOSMData` action with `id=cpi_core` to retrieve Core CPI data. Combine with fuel price data in a GCP-hosted dashboard to correlate inflation and fuel costs.
Apply Filters for Specific Analysis	Use the `contains` parameter to filter datasets by specific regions or categories (e.g., `Kuala Lumpur@location`).

Pricing

bill-and-calculator-2023-11-27-05-25-06-utc 1

Request a Quote

Support

For Technical support please contact us on

custom-connectors-support@isolutions.sa

A tech solution company dedicated to providing innovation thus empowering businesses to thrive in the digital age.

Register to Wired for Banking