TM1 Forum

• With Python libraries for functionality which is not in TM1 - eg IRR, stats
• With other products, via their Rest APIs
• With multiple TM1 instances

scrumthing wrote: ↑Mon Jun 15, 2020 10:36 am Another use case I am currently working on. Provide tm1 data for our internal data lake. We could of course export a csv file to import into the data lake. But with tm1py the data lake team can use their existing knowledge of python to extract the data whenever they have a need for an update and do not rely on someone in the tm1 team to trigger the export for them. They can easily extract all necessary metadata with one or two lines of code.

lotsaram wrote: ↑Mon Jun 15, 2020 1:23 pm External system pulls can of course be a little risky without some rules of engagement as administrators (and users) of external systems are unlikely to be aware of (or care about) peak load times in the TM1 system(s) and often such external queries are by their nature large and resource intensive.

(Quite off the main topic here but I thought relevant to point out).

scrumthing wrote: ↑Mon Jun 15, 2020 10:36 am Just to show some use cases we had so far.

We had to do a license audit and needed to provide the users for all of our tm1 instances. We have about 80 instances on 30-40 servers. Utilizing tm1py I wrote a script that logged into every instance and returned a list of users and their type via the rest api. License audit done in about 5 minutes. Try doing that any other way!

Another use case I am currently working on. Provide tm1 data for our internal data lake. We could of course export a csv file to import into the data lake. But with tm1py the data lake team can use their existing knowledge of python to extract the data whenever they have a need for an update and do not rely on someone in the tm1 team to trigger the export for them. They can easily extract all necessary metadata with one or two lines of code.

amit_hhh wrote: ↑Mon Jun 15, 2020 6:00 am 1. Why use python with TM1?
2. What are the benefits we get which we are unble to get so far with existing TM1 tools?
3. How to best use python in existing tm1 models?
4. What is the future of TM1 and python integration?
5. Has anyone used ML on top of TM1 so far? If yes, could you please share some insights how we can start doing so?

Wim Gielis wrote: ↑Mon Jun 15, 2020 4:34 pm In order to boost the adoption of tm1py and Python in cooperation with TM1, maybe it would be good to post some parts of what you used in the “Useful code, tips and tricks” subforum. Of course, anonymous data and names and such.

• Executing 'loose TI' statements actually creates/executes/deletes a process - no problem but you thus have to run it as admin;
• I had a (python) memory error writing a large cellset and found a simple pythonic way to split the cellset:

  Code: Select all

  	Cellsetsize = len(Cellset)//2
          Cellset1 = dict(list(Cellset.items())[Cellsetsize:])
          tm1.cubes.cells.write_values(cubename,Cellset1,dimensions = dims)
                          
          Cellset2 = dict(list(Cellset.items())[:Cellsetsize])
          tm1.cubes.cells.write_values(cubename,Cellset2,dimensions = dims)

scrumthing wrote: ↑Mon Jun 15, 2020 4:29 pm Not at all off topic but instead very important. We currently solved that by providing native view for the export. That way we can control the amount of data. Of course there is no way stopping all the million stupid ways people can circumvent that.

scrumthing wrote: ↑Mon Jun 15, 2020 4:29 pm But the amount of data can definitely be an issue. That is why I try to figure out a way of pagination. But that as well can only prevent some of the possible cases in that area.

David Usherwood wrote: ↑Mon Jun 15, 2020 10:03 pm I am not myself convinced that this is sensible and indeed I posted something myself on this forum's hints and tips about using TM1PY to manage ODBCOutput passwords (which ykud more or less demolished, but hey ).

ykud wrote: ↑Tue Jun 16, 2020 12:00 am Let's hijack this thread a bit

Wim Gielis wrote: ↑Mon Jun 15, 2020 4:34 pm In order to boost the adoption of tm1py and Python in cooperation with TM1, maybe it would be good to post some parts of what you used in the “Useful code, tips and tricks” subforum. Of course, anonymous data and names and such.

users =  tm1.security.get_all_users
for x in users():
    print(x._name + ';' + str(x._user_type )+ ';' + str(x._enabled ))

ykud wrote: ↑Tue Jun 16, 2020 12:00 am You can use the $top=n in Rest API to return up to n records. You can see this implemented in the execute_set_mdx method in tm1py .

ykud wrote: ↑Tue Jun 16, 2020 12:00 am Have a look at tm1cmp if you haven't already (I need to write a post about it), it has an ability to define your view as MDX or a full spec in JSON file as well that you can re-use?

hermie wrote: ↑Mon Jun 29, 2020 8:21 am

ykud wrote: ↑Tue Jun 16, 2020 12:00 am Have a look at tm1cmp if you haven't already (I need to write a post about it), it has an ability to define your view as MDX or a full spec in JSON file as well that you can re-use?

I gave tm1cmp a test drive today. Impressed, will be really useful for automated and ad hoc tests/comparisons.
You should really write a post about it!