Possibility of Amazon AWS S3 to TM1 On-Prem
-
- Regular Participant
- Posts: 155
- Joined: Fri May 20, 2011 8:17 am
- OLAP Product: Applix,Cognos TM!
- Version: applix9.0Cognos tm1 9.5.1
- Excel Version: Excel 2010 2007
Possibility of Amazon AWS S3 to TM1 On-Prem
I have requirement: I have the data in Amazon AWS S3 and i need to read the Data using TI (Tm1 10.2.2 on-prem Enviroment) and load into Cube. Is there any solution to achieve this? really appreciated any solution?
-
- Community Contributor
- Posts: 324
- Joined: Mon Jul 02, 2012 9:39 pm
- OLAP Product: TM1
- Version: PAL 2.0.8
- Excel Version: 2016
- Location: Sydney, Australia
Re: Possibility of Amazon AWS S3 to TM1 On-Prem
HI,
Are those files? AWS S3 can hold any type of files.
AWS S3 buckets contain objects, it's not a file system. As far I know you would need a 3rd party solution to "mimic" a file system behavior for S3. Probably too complicated.
If you have an option/budget you should look at AWS Redshift (storage solution). You can then load S3 objects into Redshift tables. Then you can simply use SQL to pull data out of RS into TM1.
Likewise, S3 has a support for RestAPI which you could leverage and load your data straight into your staging cube. However, would require a bit of work
Thanks
Evgeny
Are those files? AWS S3 can hold any type of files.
AWS S3 buckets contain objects, it's not a file system. As far I know you would need a 3rd party solution to "mimic" a file system behavior for S3. Probably too complicated.
If you have an option/budget you should look at AWS Redshift (storage solution). You can then load S3 objects into Redshift tables. Then you can simply use SQL to pull data out of RS into TM1.
Likewise, S3 has a support for RestAPI which you could leverage and load your data straight into your staging cube. However, would require a bit of work
Thanks
Evgeny
-
- Regular Participant
- Posts: 155
- Joined: Fri May 20, 2011 8:17 am
- OLAP Product: Applix,Cognos TM!
- Version: applix9.0Cognos tm1 9.5.1
- Excel Version: Excel 2010 2007
Re: Possibility of Amazon AWS S3 to TM1 On-Prem
thank you so much for a quick response Evgeny.
you are correct. we have the Amzon Redshift where all the flat-files are located. So, our tm1 10.2.2 On-Prem needs to connect to flat-files to read the data?. Could you please brief more about on this. maybe solution approach?
you are correct. we have the Amzon Redshift where all the flat-files are located. So, our tm1 10.2.2 On-Prem needs to connect to flat-files to read the data?. Could you please brief more about on this. maybe solution approach?
-
- Community Contributor
- Posts: 324
- Joined: Mon Jul 02, 2012 9:39 pm
- OLAP Product: TM1
- Version: PAL 2.0.8
- Excel Version: 2016
- Location: Sydney, Australia
Re: Possibility of Amazon AWS S3 to TM1 On-Prem
Your AWS DevOps engineer should be able to help with pushing S3 files into RS. Then it as simple as any using any other ODBC data source for TM1. As I can see from your other posts, you have RS ODBC set up already.
-
- Community Contributor
- Posts: 324
- Joined: Mon Jul 02, 2012 9:39 pm
- OLAP Product: TM1
- Version: PAL 2.0.8
- Excel Version: 2016
- Location: Sydney, Australia
Re: Possibility of Amazon AWS S3 to TM1 On-Prem
I am confused, files sitting in S3 bucket or already loaded into RS?mincharug.shulft wrote: ↑Thu Jan 23, 2020 10:02 pm thank you so much for a quick response Evgeny.
you are correct. we have the Amzon Redshift where all the flat-files are located. So, our tm1 10.2.2 On-Prem needs to connect to flat-files to read the data?. Could you please brief more about on this. maybe solution approach?
Thanks
Evgeny