Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gen AI Apps Overview #59

Merged
merged 63 commits into from
Jan 16, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
35e42ea
init
brown9804 Jan 6, 2025
7596239
Merge 35e42eae42cc2ce17706a5242165f5d781e55074 into 16ca09d56174c2bc9…
brown9804 Jan 6, 2025
6f5da5e
Update last modified date in Markdown files
brown9804 Jan 6, 2025
a93a8bc
visual refs
brown9804 Jan 7, 2025
4b9782f
Merge a93a8bc9161b63df01dfb229b3b90ea9ae15bec6 into 16ca09d56174c2bc9…
brown9804 Jan 7, 2025
56d0a25
Update last modified date in Markdown files
brown9804 Jan 7, 2025
2971688
in progress
brown9804 Jan 7, 2025
fbd285b
Merge 2971688c5d52c9b2d4af407dc1ac3fed2d5d5444 into 16ca09d56174c2bc9…
brown9804 Jan 7, 2025
ea44c6c
Update last modified date in Markdown files
brown9804 Jan 7, 2025
6d4212b
+ link
brown9804 Jan 7, 2025
7876ced
Merge 6d4212bfea93f8d5f8b16ba3d2ead5766fe8076e into 16ca09d56174c2bc9…
brown9804 Jan 7, 2025
62229c6
+data calculations in progress
brown9804 Jan 8, 2025
d18d203
Merge 62229c65c9859203dd02b539d7436e35a1b542ef into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
0d62cb1
Update last modified date in Markdown files
brown9804 Jan 8, 2025
76cff8e
working on visualizations part
brown9804 Jan 8, 2025
c6891de
Merge 76cff8efabda2fa21e75bc02c01d1594a429b7d3 into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
e7195f6
in progress
brown9804 Jan 8, 2025
bedb2d1
Merge e7195f6cd92337e78aa517ba81b6fdbaf2d66489 into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
7e604d2
visualizations in progress
brown9804 Jan 8, 2025
720c1cc
Merge 7e604d29c3a6fc30e4658b3ac59d31c90627b0da into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
b40f245
+ how to make it permanent
brown9804 Jan 8, 2025
0698dcc
Merge b40f24577baa983e1bf31ac8e646920db8b52930 into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
146a4aa
Update last modified date in Markdown files
brown9804 Jan 8, 2025
36f9c84
+ link
brown9804 Jan 8, 2025
004f4dc
Merge 36f9c8488b2cc74b6554b81eb5df9702a067ef0e into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
e585f7a
size
brown9804 Jan 8, 2025
2d93b19
Merge e585f7a0ea3a39cb2ca029fc8ccab7f196ff2d0b into 16ca09d56174c2bc9…
brown9804 Jan 8, 2025
173a13f
lifecycle, data ingest + visualizations -> in place
brown9804 Jan 9, 2025
5129e8b
Merge 173a13fb2bb66811b4cb8be9c23eee431434f10c into 16ca09d56174c2bc9…
brown9804 Jan 9, 2025
526ad6b
Update last modified date in Markdown files
brown9804 Jan 9, 2025
8835bcf
+ sharing, licenses omit (review sku and migrationptosku), admin
brown9804 Jan 9, 2025
8bed460
Merge 8835bcf42e016bfed0643e9791e6f2b5f34c83d8 into 16ca09d56174c2bc9…
brown9804 Jan 9, 2025
7380984
in place -> overview on how to transition
brown9804 Jan 9, 2025
9c182ce
format
brown9804 Jan 9, 2025
80659b1
Merge 9c182ce49131befcd68a68a4aef88dbd69bef151 into 16ca09d56174c2bc9…
brown9804 Jan 9, 2025
7bf91ab
links
brown9804 Jan 9, 2025
18f7d24
Merge 7bf91abe8f0cafca8246be4c9e886ed1aa2e19ab into 16ca09d56174c2bc9…
brown9804 Jan 9, 2025
50e08b1
+ table of content
brown9804 Jan 10, 2025
b98b0c9
Merge 50e08b119220ca42a1566fd72f2e2c62e2e43f9d into 16ca09d56174c2bc9…
brown9804 Jan 10, 2025
afbc9d8
Update last modified date in Markdown files
brown9804 Jan 10, 2025
c6cafe0
added visual guidance of pricing calc
brown9804 Jan 10, 2025
78b2534
Merge c6cafe0f15ad6693cefe0d4ba15e991973614388 into 16ca09d56174c2bc9…
brown9804 Jan 10, 2025
4ae9bd0
Update last modified date in Markdown files
brown9804 Jan 10, 2025
87c779e
Title
brown9804 Jan 12, 2025
886ee01
Merge 87c779e802e8cc6438b56ad0624b0be2c3debdf3 into 16ca09d56174c2bc9…
brown9804 Jan 12, 2025
da4505e
Update last modified date in Markdown files
brown9804 Jan 12, 2025
a5ed743
init
brown9804 Jan 13, 2025
9144a85
Merge a5ed74383e668eed2208cfa8fa90633f0f72bf81 into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
da932fb
Update last modified date in Markdown files
brown9804 Jan 13, 2025
092324f
Update 0_upgrade_spark_version_az_synapse.md
brown9804 Jan 13, 2025
abd56d9
Merge 092324f6ff6f8657a31075eb2be4789c5e3d5c4e into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
332d9b2
oerview about how to upgrade apache spark pool
brown9804 Jan 13, 2025
96da003
Merge 332d9b2fecb5699f49053ccd84ce4cda803dd22e into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
0ab050d
get started with basics
brown9804 Jan 13, 2025
e70155a
Merge 0ab050da87779ed1c90ed2a7d3776ec81704378e into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
47b7d5d
format pending to review 2/7
brown9804 Jan 13, 2025
4b1ed4e
Merge 47b7d5d9fa4d4190b22f1acfbff912372326d62a into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
3f372e8
in progress life cycle
brown9804 Jan 13, 2025
edf2d17
Merge 3f372e88f53ecf91ebb875fde5b480d1d0a6c9a5 into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
70d04b0
in progress
brown9804 Jan 13, 2025
59dee00
Merge 70d04b06480c3949a329b84b7c3e2538ad9350a9 into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
3031ddf
connections and runtimes - in progress
brown9804 Jan 13, 2025
05ce4e4
Merge 3031ddf790a026c57150759ced1d57a6e083e786 into 16ca09d56174c2bc9…
brown9804 Jan 13, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 29 additions & 3 deletions 0_Azure/1_AzureData/1_Databases/demos/8_DBFreeingUpUnusedSpace.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Costa Rica
[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
[brown9804](https://github.com/brown9804)

Last updated: 2024-12-24
Last updated: 2025-01-13

----------

Expand All @@ -21,7 +21,8 @@ Last updated: 2024-12-24
- [Types of Databases](https://azure.microsoft.com/en-gb/products/category/databases/)
- [Shrink Database Task (Maintenance Plan)](https://learn.microsoft.com/en-us/sql/relational-databases/maintenance-plans/shrink-database-task-maintenance-plan?view=sql-server-ver16)
- [Manage file space for databases in Azure SQL Database](https://learn.microsoft.com/en-us/azure/azure-sql/database/file-space-manage?view=azuresql-db)

- [DBCC SHRINKFILE (Transact-SQL)](https://learn.microsoft.com/en-us/sql/t-sql/database-console-commands/dbcc-shrinkfile-transact-sql?view=sql-server-ver16)

</details>

## Content
Expand Down Expand Up @@ -348,8 +349,24 @@ For Azure SQL Managed Instance, consider these strategies:
-- Shrink the database file (replace 1 with your file_id)
DBCC SHRINKFILE (1);
```

<img width="550" alt="image" src="https://github.com/user-attachments/assets/96c7be25-ade3-4851-a2cd-8735273c4c6f">

> If you specify a target size that is just enough to hold all the data pages, the result can be a file with no free space.

**Before Shrink:**

| $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ | $${\color{green}\text{Free Space}}$$ |

- **After Shrink with TRUNCATEONLY:** When you use DBCC SHRINKFILE with the TRUNCATEONLY option `DBCC SHRINKFILE (file_id, TRUNCATEONLY)`, it releases the unused space at the end of the file without moving any data pages. This means that the data pages remain in their original locations, and only the free space at the end of the file is released.

| $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ | $${\color{red}\text{Data Page}}$$ |

> If you don't move the pages, the space within the file might not be optimized because the data pages could be scattered throughout the file, leaving gaps of unused space in between. This can lead to fragmentation, where the data is not stored contiguously, potentially affecting performance. In this case, the free space at the end is released, but the data pages remain scattered, which might not be optimal for performance.

- After `DBCC SHRINKFILE (file_id, target_size_in_MB)`: In this case, the data pages are moved to fill the gaps, and the file is shrunk to the target size, eliminating free space.

| $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ |

3. **Monitor the Shrink Operation**: While the shrink operation is running, you can monitor for any blocking operations that might be affecting the process.

Expand Down Expand Up @@ -401,9 +418,18 @@ For Azure SQL Managed Instance, consider these strategies:


6. **Shrinking the Database**: Reclaim unused space with. Shrink the entire database to leave 10% free space.

```sql
DBCC SHRINKDATABASE (YourDatabaseName, 10);
```

**Before Shrink:**

| $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ | $${\color{green}\text{Free Space}}$$ |

After `DBCC SHRINKDATABASE (database_name, target_percent_free_space)`: The data pages are moved to reduce fragmentation, and the file is shrunk to maintain a small percentage of free space.

| $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{red}\text{Data Page}}$$ | $${\color{green}\text{Free Space}}$$ |

<img width="550" alt="image" src="https://github.com/user-attachments/assets/f906adcd-732e-4efa-849c-90d8fed2e9d3">

Expand Down
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
# Connecting Microsoft Fabric to HDI Platform
# Connecting Microsoft Fabric to Azure HDI Platform

Costa Rica

[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
[brown9804](https://github.com/brown9804)

Last updated: 2024-11-19
Last updated: 2025-01-13

----------

Expand Down
23 changes: 20 additions & 3 deletions 0_Azure/2_AzureAnalytics/0_Fabric/demos/12_FabricReservation.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Costa Rica
[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
[brown9804](https://github.com/brown9804)

Last updated: 2024-11-19
Last updated: 2025-01-13

------------------------------------------

Expand All @@ -22,7 +22,7 @@ Last updated: 2024-11-19
## Wiki

<details>
<summary><b>Table of Contents</b> (Click to expand)</summary>
<summary><b>Table of Wiki</b> (Click to expand)</summary>

- [Microsoft Fabric trial capacity](https://learn.microsoft.com/en-us/fabric/get-started/fabric-trial)
- [Buy a Microsoft Fabric subscription](https://learn.microsoft.com/en-us/fabric/enterprise/buy-subscription)
Expand All @@ -37,6 +37,23 @@ Last updated: 2024-11-19

</details>

## Content

<details>
<summary><b>Table of Content</b> (Click to expand)</summary>

- [Wiki](#wiki)
- [Content](#content)
- [Overview](#overview)
- [Reservations & Capacity](#reservations--capacity)
- [Scope Assignment in Reservations](#scope-assignment-in-reservations)
- [How to make a reservation](#how-to-make-a-reservation)
- [Creating/Linking Fabric Capacity to Your Reservation](#creatinglinking-fabric-capacity-to-your-reservation)
- [Assign Workspace Capacity](#assign-workspace-capacity)
- [How to Change Scope of a Reservation](#how-to-change-scope-of-a-reservation)

</details>

## Overview

| **Benefit** | **Description** |
Expand Down Expand Up @@ -164,4 +181,4 @@ Overall process:
<div align="center">
<h3 style="color: #4CAF50;">Total Visitors</h3>
<img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/>
</div>
</div>
Loading