Read sql server data Using synapse notebook

   serverName=mssparkutils.credentials.getSecret("kvidpresources","rio-assurance-server","lsidpkeyvault")

        databaseName=mssparkutils.credentials.getSecret("kvidpresources","rio-assurance-database","lsidpkeyvault") 
        userName=mssparkutils.credentials.getSecret("kvidpresources","rio-assurance-db-user","lsidpkeyvault")
        password=mssparkutils.credentials.getSecret("kvidpresources","rio-assurance-db-password","lsidpkeyvault")
        server_name = "jdbc:sqlserver://"+serverName
        database_name = databaseName
        url = server_name + ";" + "databaseName=" + database_name + ";"
        username = userName
        password = password 
        #fetch json pointer values and target schema details for flattening json string
        query_jsonpointer = f"Select source_pointer,src_schema_name,tgt_schema_name,table_name from ctl.map_all_jsonpointer  where event_name='testevent3'"
        df_jsonpointer = spark.read \
        .format("com.microsoft.sqlserver.jdbc.spark") \
        .option("url", url) \
        .option("query", query_jsonpointer) \
        .option("user", username) \
        .option("password", password).load()

Comments

Post a Comment

Popular posts from this blog

Introduction To Oracle10g

                                                  Oracle Database 10 g, released in 2003 and the current release, enables grid (the g in 10g) computing. A grid is simply a pool of computers that provides needed resources for applications on an as-needed basis. The goal is to provide computing resources that transparently scale to the user community, much as an electrical utility company can deliver power to meet peak demand by accessing energy from other power providers’ plants via a power grid. Oracle Database 10 g further reduces the time, cost, and complexity of database management through the introduction of self-managing features such as the Automated Database Diagnostic Monitor, Automated Shared Memory Tuning, Automated Storage Management, and Automa...
Read more

Insert

Image
      Syntax: INSERT INTO table (column-1, column-2, ... column-n) VALUES (value-1, value-2, ... value-n);                      If we are inserting datas to entire fields then no need to specify the fieldnames.        Example:                                   INSERT INTO EMPLOYEE_DETAILS    VALUES('Akhilash',22,2500,'Developer');          INSERT INTO EMPLOYEE_DETAILS    VALUES('Akhilash',22,250.90,'Developer');     INSERT INTO EMPLOYEE_DETAILS    VALUES('Akhilash',22,250.90,'Developer');     OutPut             ...
Read more

Except

Selecting records from a table, that is not existing in another table.              We can use the keyword EXCEPT example:        select   * from emp1 except select * from emp2   It will display records that exist in emp1 but not in emp2
Read more