function history to download Bloomberg data runs slow

Question

Shiping Yang 2022-4-22

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1702205-function-history-to-download-bloomberg-data-runs-slow

回答： Simar 2024-1-25

I am using Matlab function history to download data from Bloomberg.

history(c,s,f,fromdate,todate,period)

s = a list of 70 securities.

f = three fields.

fromdate = 12/31/1999

todate = 4/20/2022

period = {'daily','actual','all_calendar_days','previous_value'};

It takes about 20 minutes to execute the command. I understand the data is about 21+ years. It may be expected that it takes longer time to run. But when I tried to download 2 weeks of data, it completes in a few seconds. 20 minutes for 21+ years of historical data seems too long.

Did anyone experience the same issue? Is there any way to optimize the way I download the historical data please?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Simar 2024-1-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1702205-function-history-to-download-bloomberg-data-runs-slow#answer_1397076

Hi Shiping Yang,

I understand that you are looking for strategies to optimize the data download process to reduce the time taken. Since downloading a large amount of historical data from Bloomberg using the MATLAB “history” function, it might take considerate amount of time.

Here are some suggestions to potentially optimize the data download process:

Parallel Requests: If having access to MATLAB's Parallel Computing Toolbox, try to split requests into smaller batches and use parallel processing to download them concurrently.
Limit Fields: Review the fields being requested. If there are fields that are not strictly needed, consider removing them from request to reduce the amount of data being transferred.
Bloomberg API Limitations: The Bloomberg API itself might have limitations on data retrieval rates, which can affect the time taken to download historical data. Check if there are any such limitations and if they are configurable.
Caching: If frequently need to access the same historical data, consider caching it locally after the initial download so that only need to retrieve incremental updates on subsequent requests.
Data Compression: Check if the Bloomberg service allows for data compression options during transfer, which could reduce the amount of data being sent over the network.
Optimize MATLAB Code: Review MATLAB code for any inefficiencies. For example, preallocate memory for large datasets, use efficient data types, and avoid unnecessary loops or computations within data retrieval script.
Incremental Downloads: Instead of downloading the entire dataset in one go, consider breaking it down into smaller time frames and incrementally appending the results. This approach can sometimes be more efficient and allows for intermediate saving and checkpointing.

Remember to test any changes with a smaller subset of data first to ensure that they provide a performance improvement before applying them to the full 21+ years of data.

Please refer to the following links:

Hope it helps!

Best Regards,

Simar