全部版块 我的主页
论坛 数据科学与人工智能 数据分析与数据科学 SAS专版
1189 0
2018-07-06




Abstract
Today the tremendous Big and complex data files are keeping changing, it causes more and more troubles to handle these data files with higher requirements. Banking is not an exception too, among daily work, how to handle tremendous data files, and significantly decrease execution time is a hot topic. We have many technical skills such as parallel runs, they work very well but with short-comings, and cannot hugely shorten the execution time. We found if we optimize the logic a little bit to handle the business requirements, process the steps with a combination processing or set processing method, we can hugely decrease the execution time. It does not require additional server memory, additional money, but can significantly decrease huge amount running time for our SAS engines. The more the number of data files, the larger of them, the more time we can decrease if we can mix SAS technical skills, parallel run or multiple threads and combination processing method into SAS engine. It can decrease more than 90% of execution time. We already did it.
Actually we already proved that this method does not only work in SAS language but also Python, and other computer languages.
Key Words:  Large Data, shorten execution time, optimization, Combination Processing Method or Set Processing Method

二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

栏目导航
热门文章
推荐文章

说点什么

分享

扫码加好友,拉您进群
各岗位、行业、专业交流群